Data Engineering Implementation: Execute the end-to-end backfill process for high-frequency MBO (Market-By-Order) historical data, managing everything from raw PCAP packet processing to the cleaning, standardization, and final delivery of high-fidelity MBO data.
Data Pipeline Operations & Adaptation: Actively participate in the daily operations of a high-volume data scheduling system based on Dagster; handle routine task monitoring, troubleshooting, and recovery/re-runs; and—under mentor guidance—rapidly adapt to and implement changes in exchange-level underlying protocols.
Data Quality Assurance: Develop data quality validation rules and automation scripts; perform initial analysis and diagnosis (first-line diagnosis) for data quality anomalies detected during daily operations.
Quantitative Research Support: Serve as a frontline point of contact to efficiently support quantitative researchers' data needs, assisting in identifying, explaining, and resolving complex issues related to market data encountered during the research and investment process.