API Rate Limiting & Scalability Patterns · 课时

内存限流器设计

使用常见编程模式设计并实现基本的内存限流器，适用于单实例应用程序。

第 1 / 4 课12 个步骤

内存限流器设计 是 CoddyKit 上的免费 API Rate Limiting & Scalability Patterns 课时。这是第 1 节课，共 4 节。你可以在下方免费阅读本课时的完整内容 — 然后在浏览器中使用内置代码编辑器和全天候 AI 导师进行实践。这是 API Rate Limiting & Scalability Patterns 学习路径的一部分，你的进度在网页和 CoddyKit 应用中同步。 API Rate Limiting & Scalability Patterns 课程共包含 4 节课。

本课时的部分内容尚未翻译，以英文显示。

Intro to In-Memory Limiting

Welcome to designing an in-memory rate limiter! This is the simplest type of rate limiter, perfect for understanding the core concepts.

An in-memory rate limiter stores all its tracking data (like how many requests a user has made) directly in the application's RAM, not in a separate database or service.

This makes it fast and easy to set up, but it comes with specific limitations we'll explore.

Why Use In-Memory?

In-memory rate limiters are ideal for:

Single-instance applications: Where your application runs on just one server.
Quick prototypes: To test rate limiting concepts without complex infrastructure.
Non-critical APIs: Where occasional dropped requests due to server restarts are acceptable.

They are simple to implement because they don't need to communicate with external data stores.

Core Design Concepts

Every rate limiter needs to track a few key pieces of information:

Client ID: Who is making the request? (e.g., IP address, user ID, API key)
Request Limit: How many requests are allowed? (e.g., 100 requests)
Time Window: Over what period? (e.g., per minute, per hour)

Our in-memory design will use these concepts to decide if a request is allowed or denied.

Choosing a Strategy: Fixed Window

For our basic in-memory limiter, we'll use the Fixed Window Counter algorithm. It's straightforward:

Requests are counted within a specific, fixed time window (e.g., 0-59 seconds, 60-119 seconds).
When a new window starts, the counter resets to zero.
If the request count exceeds the limit within the current window, new requests are denied.

While simple, it's a great starting point for understanding rate limiting mechanics.

Data Structures for Tracking

To keep track of requests for different clients within their time windows, we'll use Java's ConcurrentHashMap:

counts: A map to store the number of requests for each clientId (e.g., "user1" -> 5).
windowStarts: A map to store the start time of the current window for each clientId (e.g., "user1" -> 1678886400000L).

ConcurrentHashMap is thread-safe, which is important when multiple requests might hit our limiter at the same time.

Building the Limiter Class

Let's start by defining our InMemoryRateLimiter class. It will hold our configuration (limit and window duration) and the maps for tracking.

Here's the basic structure:

import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicInteger;

public class InMemoryRateLimiter {
    private final int limit; // Max requests allowed
    private final long windowMillis; // Time window in milliseconds

    private final ConcurrentHashMap<String, AtomicInteger> counts = new ConcurrentHashMap<>();
    private final ConcurrentHashMap<String, Long> windowStarts = new ConcurrentHashMap<>();

    public InMemoryRateLimiter(int limit, long windowMillis) {
        this.limit = limit;
        this.windowMillis = windowMillis;
    }

    // The allowRequest method will go here
}

Implementing `allowRequest` - Part 1

The heart of our limiter is the allowRequest(String clientId) method. This method will determine if a request from a given client should be allowed.

First, we get the current time and initialize the window start time for the client if it's their first request:

import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicInteger;

public class InMemoryRateLimiter {
    private final int limit;
    private final long windowMillis;

    private final ConcurrentHashMap<String, AtomicInteger> counts = new ConcurrentHashMap<>();
    private final ConcurrentHashMap<String, Long> windowStarts = new ConcurrentHashMap<>();

    public InMemoryRateLimiter(int limit, long windowMillis) {
        this.limit = limit;
        this.windowMillis = windowMillis;
    }

    public boolean allowRequest(String clientId) {
        long currentTime = System.currentTimeMillis();

        // Get or initialize window start time for this client
        long currentWindowStart = windowStarts.computeIfAbsent(clientId, k -> currentTime);

        // ... more logic to come ...
        return false; // Placeholder
    }
}

Implementing `allowRequest` - Part 2

Next, we add the logic to check if the current time window has expired. If it has, we reset the window start time and the request count for that client.

This ensures that when a new window begins, clients get a fresh quota of requests.

import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicInteger;

public class InMemoryRateLimiter {
    private final int limit;
    private final long windowMillis;

    private final ConcurrentHashMap<String, AtomicInteger> counts = new ConcurrentHashMap<>();
    private final ConcurrentHashMap<String, Long> windowStarts = new ConcurrentHashMap<>();

    public InMemoryRateLimiter(int limit, long windowMillis) {
        this.limit = limit;
        this.windowMillis = windowMillis;
    }

    public boolean allowRequest(String clientId) {
        long currentTime = System.currentTimeMillis();
        long currentWindowStart = windowStarts.computeIfAbsent(clientId, k -> currentTime);

        // If the current window has expired, reset it
        if (currentTime - currentWindowStart >= windowMillis) {
            windowStarts.put(clientId, currentTime); // Start a new window
            counts.put(clientId, new AtomicInteger(0)); // Reset count
        }

        // ... more logic to come ...
        return false; // Placeholder
    }
}

Implementing `allowRequest` - Part 3

Finally, we increment the request count for the client and check if it's still within the allowed limit. If it is, the request is allowed; otherwise, it's denied.

The AtomicInteger ensures thread-safe increments.

import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicInteger;

public class InMemoryRateLimiter {
    private final int limit;
    private final long windowMillis;

    private final ConcurrentHashMap<String, AtomicInteger> counts = new ConcurrentHashMap<>();
    private final ConcurrentHashMap<String, Long> windowStarts = new ConcurrentHashMap<>();

    public InMemoryRateLimiter(int limit, long windowMillis) {
        this.limit = limit;
        this.windowMillis = windowMillis;
    }

    public boolean allowRequest(String clientId) {
        long currentTime = System.currentTimeMillis();
        long currentWindowStart = windowStarts.computeIfAbsent(clientId, k -> currentTime);

        if (currentTime - currentWindowStart >= windowMillis) {
            windowStarts.put(clientId, currentTime);
            counts.put(clientId, new AtomicInteger(0));
        }

        // Increment count and check if within limit
        AtomicInteger clientCount = counts.computeIfAbsent(clientId, k -> new AtomicInteger(0));
        if (clientCount.incrementAndGet() <= limit) {
            return true; // Request allowed
        } else {
            return false; // Request denied
        }
    }

    public static void main(String[] args) {
        // Example usage will go here
    }
}

Full Example and Testing

Let's put it all together and test our in-memory rate limiter! This example creates a limiter allowing 3 requests per 5 seconds for a specific user.

Run the code and observe how requests are allowed initially, then denied, and finally allowed again after the time window resets.

import java.util.concurrent.ConcurrentHashMap;
import java.util.concurrent.atomic.AtomicInteger;

public class InMemoryRateLimiter {
    private final int limit;
    private final long windowMillis;

    private final ConcurrentHashMap<String, AtomicInteger> counts = new ConcurrentHashMap<>();
    private final ConcurrentHashMap<String, Long> windowStarts = new ConcurrentHashMap<>();

    public InMemoryRateLimiter(int limit, long windowMillis) {
        this.limit = limit;
        this.windowMillis = windowMillis;
    }

    public boolean allowRequest(String clientId) {
        long currentTime = System.currentTimeMillis();
        long currentWindowStart = windowStarts.computeIfAbsent(clientId, k -> currentTime);

        if (currentTime - currentWindowStart >= windowMillis) {
            windowStarts.put(clientId, currentTime);
            counts.put(clientId, new AtomicInteger(0));
        }

        AtomicInteger clientCount = counts.computeIfAbsent(clientId, k -> new AtomicInteger(0));
        if (clientCount.incrementAndGet() <= limit) {
            return true;
        } else {
            return false;
        }
    }

    public static void main(String[] args) throws InterruptedException {
        // Allow 3 requests per 5 seconds for "user1"
        InMemoryRateLimiter limiter = new InMemoryRateLimiter(3, 5000);

        String user = "user1";
        System.out.println("Testing rate limiter for " + user + ": 3 requests / 5 seconds\n");

        for (int i = 0; i < 5; i++) {
            boolean allowed = limiter.allowRequest(user);
            System.out.println("Request " + (i + 1) + ": " + (allowed ? "Allowed" : "Denied"));
            if (i == 2) { // After 3rd request, wait for window to reset
                System.out.println("\n--- Max requests reached. Waiting for window reset (5.5s) ---\n");
                Thread.sleep(5500); // Wait for window to reset
            }
        }

        System.out.println("\n--- Testing after window reset ---\n");
        for (int i = 0; i < 2; i++) {
            boolean allowed = limiter.allowRequest(user);
            System.out.println("Request " + (i + 1) + ": " + (allowed ? "Allowed" : "Denied"));
        }
    }
}

Understanding In-Memory Limitations

While simple and fast, in-memory rate limiters have a critical limitation. Imagine you deploy your application on multiple servers to handle more traffic.

What happens if requests from the same user go to different servers?

在交互式课程中回答

Recap: In-Memory Rate Limiting

You've successfully designed and understood a basic in-memory rate limiter!

We defined an in-memory rate limiter and its use cases for single-instance apps.
We explored key concepts: client ID, limit, and time window.
We implemented a Fixed Window Counter using ConcurrentHashMap in Java.
You now understand its primary limitation: it's not suitable for distributed systems due to its lack of shared state.

This foundational knowledge is crucial before diving into more advanced, distributed rate limiting solutions!

免费开始

用 AI 导师学习 API Rate Limiting & Scalability Patterns — 免费

在浏览器中编写并运行真实代码，获得全天候 AI 导师的即时帮助，并在网页或应用中继续学习。

课程: 12
课程: 48

免费开始学习查看完整课程

常见问题解答

「内存限流器设计」课时是免费的吗？

是的 — 「内存限流器设计」的完整文本可在网页上免费阅读。要进行交互式练习（内置代码编辑器和全天候 AI 导师）并解锁 API Rate Limiting & Scalability Patterns 课程的其余内容，请升级到 CoddyKit PRO。 API Rate Limiting & Scalability Patterns 课程共包含 4 节课。

「内存限流器设计」这节课中我会学到什么？

使用常见编程模式设计并实现基本的内存限流器，适用于单实例应用程序。你通过在浏览器中直接运行的动手代码来练习 API Rate Limiting & Scalability Patterns，全天候 AI 导师会在你学习这节课的过程中回答你的问题。

学习 API Rate Limiting & Scalability Patterns 需要有经验吗？

无需任何先前经验。CoddyKit 上的 API Rate Limiting & Scalability Patterns 课程适合初学者到高级学习者，你可以从这里开始或从头开始，按照自己的节奏学习。这是第 1 节课，共 4 节。

「内存限流器设计」课时需要多长时间？

大多数 CoddyKit 课程大约需要 5–10 分钟。每节课都很精短且互动，所以你能稳步进步，并在网页和应用中从离开的地方继续。

我能在这节 API Rate Limiting & Scalability Patterns 课中编写并运行代码吗？

能。每节 API Rate Limiting & Scalability Patterns 课都包含内置代码编辑器，你可以在浏览器中直接编写并运行真实代码，并获得即时 AI 反馈 — 无需本地设置。

此课程中的所有课时

← 返回 API Rate Limiting & Scalability Patterns