From 5d4dac6bafe5e60d338e588f74426935c3efd949 Mon Sep 17 00:00:00 2001 From: Kevin Liu Date: Sat, 4 Jul 2020 10:53:56 -0400 Subject: [PATCH] Fix typo: Change replication to federation (#418) --- solutions/system_design/web_crawler/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/solutions/system_design/web_crawler/README.md b/solutions/system_design/web_crawler/README.md index d95dc10..355d36d 100644 --- a/solutions/system_design/web_crawler/README.md +++ b/solutions/system_design/web_crawler/README.md @@ -282,7 +282,7 @@ Some searches are very popular, while others are only executed once. Popular qu Below are a few other optimizations to the **Crawling Service**: -* To handle the data size and request load, the **Reverse Index Service** and **Document Service** will likely need to make heavy use sharding and replication. +* To handle the data size and request load, the **Reverse Index Service** and **Document Service** will likely need to make heavy use sharding and federation. * DNS lookup can be a bottleneck, the **Crawler Service** can keep its own DNS lookup that is refreshed periodically * The **Crawler Service** can improve performance and reduce memory usage by keeping many open connections at a time, referred to as [connection pooling](https://en.wikipedia.org/wiki/Connection_pool) * Switching to [UDP](https://github.com/donnemartin/system-design-primer#user-datagram-protocol-udp) could also boost performance