Data Engineer

Job description Responsibility: Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .Utilize Hive, Spark, and Presto for big data processing and analysis Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency Collaborate with data analysts and business units to understand data requirements and provide technical support .Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations Optimize data processing workflows to improve efficiency and performance Support business-related data push and dashboard development requirements Support the collection of competitor-related data and build the infrastructure for competitive analysis Write and maintain technical documentation to ensure code maintainability and scalability Requirement: Bachelor’s degree or higher in Computer Science, Information Technology, Data Science, or a related field At least 3 years of experience in big data engineering . Business analysis experience is a plus.Proficient in Hive, Spark, and Presto for data processing and analysis Strong ETL development experience and familiar with common data transformation tools Proficient in data visualization tools such as Tableau, Power BI, or similar Strong programming skills in Python (Required)； Java, or Scala is a plus Knowledge of Docker, Kubernetes, and Bash scripting is a plus Crypto or Web3 related working experience is a plus About Bybit: Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner.Responsibility: Design , Construct, and Maintain efficient and reliable data Pipeline and Warehouse from diverse data .Utilize Hive, Spark, and Presto for big data processing and analysis Develop and maintain ETL (Extract, Transform, Load) processes to ensure data integrity and consistency Collaborate with data analysts and business units to understand data requirements and provide technical support .Build a resilient data architecture from complex data sources, ensuring alignment and accuracy in data calculations Optimize data processing workflows to improve efficiency and performance Support business-related data push and dashboard development requirements Support the collection of competitor-related data and build the infrastructure for competitive analysis Write and maintain technical documentation to ensure code maintainability and scalability Requirement: Bachelor’s degree or higher in Computer Science, Information Technology, Data Science, or a related field At least 3 years of experience in big data engineering . Business analysis experience is a plus.Proficient in Hive, Spark, and Presto for data processing and analysis Strong ETL development experience and familiar with common data transformation tools Proficient in data visualization tools such as Tableau, Power BI, or similar Strong programming skills in Python (Required)； Java, or Scala is a plus Knowledge of Docker, Kubernetes, and Bash scripting is a plus Crypto or Web3 related working experience is a plus About Bybit: Established in March 2018, Bybit is one of the fastest growing cryptocurrency derivatives exchanges, with more than 40 million registered users. We aim to continue revolutionizing the industry by fusing the best of cryptocurrency and traditional finance. Our innovative, highly advanced, user-friendly platform has been designed from the ground-up using best-in-class infrastructure to provide our users with the industry's safest, fastest, fairest, and most transparent trading experience. Built on customer-centric values, we endeavour to provide a professional, 24/7 multi-language customer support to help in a timely manner. #J-18808-Ljbffr