mirror of https://github.com/twitter/the-algorithm.git synced 2024-12-22 15:15:36 +00:00

History

twitter-team 617c8c787d Open-sourcing Unified User Actions Unified User Action (UUA) is a centralized, real-time stream of user actions on Twitter, consumed by various product, ML, and marketing teams. UUA makes sure all internal teams consume the uniformed user actions data in an accurate and fast way.		2023-04-14 16:45:37 -05:00
..
adapter/src	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
client/src	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
enricher	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
graphql	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
kafka/src	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
scripts	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
service	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
thrift/src	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
.gitignore	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
BUILD.bazel	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00
README.md	Open-sourcing Unified User Actions	2023-04-14 16:45:37 -05:00

README.md

Unified User Actions (UUA)

Unified User Actions (UUA) is a centralized, real-time stream of user actions on Twitter, consumed by various product, ML, and marketing teams. UUA reads client-side and server-side event streams that contain the user's actions and generates a unified real-time user actions Kafka stream. The Kafka stream is replicated to HDFS, GCP Pubsub, GCP GCS, GCP BigQuery. The user actions include public actions such as favorites, retweets, replies and implicit actions like bookmark, impression, video view.

Components

adapter: transform the raw inputs to UUA Thrift output
client: Kafka client related utils
kafka: more specific Kafka utils like customized serde
service: deployment, modules and services