mirror of
https://github.com/twitter/the-algorithm.git
synced 2024-12-22 14:35:37 +00:00
ef4c5eb65e
Please note we have force-pushed a new initial commit in order to remove some publicly-available Twitter user information. Note that this process may be required in the future. |
||
---|---|---|
.. | ||
pipeline-indexer.userupdates.xml | ||
pipeline-ingester.protected.xml | ||
pipeline-ingester.realtime.xml | ||
pipeline-ingester.realtime_cg.xml | ||
README.md |
Ingester Configs
This directory contains pipeline configurations for the tweet ingesters (realtime, protected and realtime_cg) and the user-updates ingester. The pipeline configurations define an ordered sequence of stages that the tweet or user update goes through before reaching Earlybird. Source code for the various stages referenced in the configs can be found at src/java/com/twitter/search/ingester/pipeline/twitter.