ptarjan

Scaling your API with rate limiters

The following are examples of the four types rate limiters discussed in the accompanying blog post. In the examples below I've used pseudocode-like Ruby, so if you're unfamiliar with Ruby you should be able to easily translate this approach to other languages. Complete examples in Ruby are also provided later in this gist.

In most cases you'll want all these examples to be classes, but I've used simple functions here to keep the code samples brief.

Request rate limiter

This uses a basic token bucket algorithm and relies on the fact that Redis scripts execute atomically. No other operations can run between fetching the count and writing the new count.

AndrewDryga

defmodule DynamicChangeset do
  @moduledoc """
  This module provides helper functions to extend `Ecto.Changeset` to support
  dynamic embeds.
  """
  alias Ecto.Changeset

  @doc """
  Casts the given embed with the embedded changeset and field which is used to define it's type.

jackbkennedy

import {useState, useEffect, useCallback} from 'react';

const EVENT_KEY_DOWN = 'keydown';
const EVENT_KEY_UP = 'keyup';

/* Hook to verify state of Caps Lock */
export function useCaplocks(): boolean {
  /* State for keeping track of whether caps lock is on */
  const [isCaplocksActive, setIsCapLocksActive] = useState<boolean>(false);

joshnuss

defmodule MyApp.Integrations.Skubana do
  @host "..."
  @headers [ ... ]

  # returns a stream of shipments
  def get_shipments do
    # start with page 1
    start = fn -> 1 end
    
    # create a stream, it will make HTTP requests until the page returned is empty

jackbkennedy

// This function runs automatically when the Google Sheet is opened.
function onOpen() {
  // Obtain the user interface of the Google Spreadsheet.
  var ui = SpreadsheetApp.getUi();
  
  // Create a custom menu titled 'AI Content Generation' in the Spreadsheet's menu bar.
  ui.createMenu('AI Content Generation')
      // Add a menu item 'Generate All Values' that when clicked, will run the function 'generateAllValues'.
      .addItem('Generate All Values', 'generateAllValues')
      // Add another menu item 'Update Missing Only' that when clicked, will run the function 'updateMissingValues'.

jackbkennedy

import React, { useEffect, useRef, useState } from 'react';
import ReactDOM from 'react-dom';

type ZoomableImageProps = {
  url: string;
  style?: React.CSSProperties; // for custom styles
  className?: string; // to allow custom classes
};

/*

PJUllrich

defmodule MyApp.Http do
  @moduledoc """
  Exposes functions to make HTTP requests and optionally cache the response.

  If you want to cache the request, simply add `cache: true` to the 
  request options. You can also define an option time-to-live (TTL) with
  `cache_ttl: ttl_in_milliseconds`. The default TTL is 5min.

  Only caches 2xx responses.
  """