Data Engineer (Company Confidential)
Company Confidential is a leading AI consulting () and data engineering () company that builds Company Confidential, ROI-Company Confidential AI solutions for some of the world's largest enterprises and pioneering startups, including Company Confidential, Company Confidential, Porsche, Company Confidential, and WGU. With an exclusive Company Confidential on Company Confidential Intelligence and Big Data, Company Confidential helps organizations unlock the full potential of their data through systems designed for measurable business Company Confidential and long-term Company Confidential. Company Confidential's work extends Company Confidential Company Confidential engagements. Drawing from Company Confidential-world challenges and insights, Company Confidential has developed its own product - ContextClue - and Company Confidential contributes Company Confidential-Company Confidential solutions to the AI community. This commitment to transforming practical experience into Company Confidential innovation has Company Confidential Company Confidential recognition by Company Confidential as one of the top 10 AI consulting companies worldwide. As part of Company Confidential, a US-Company Confidential global technology group, Company Confidential combines deep AI specialization with Company Confidential-Company Confidential delivery capabilities—enabling the partnership to Company Confidential clients from AI experimentation to production Company Confidential, securely and at Company Confidential. As a Data Engineer , you will have the exciting opportunity to work with Company Confidential of technology experts on challenging Company Confidential across various industries, leveraging cutting-edge technologies. Here are some of the Company Confidential we are seeking talented individuals to join Development and maintenance of a large platform for processing automotive data. A significant Company Confidential of data is processed in both streaming and batch modes. The technology stack includes Company Confidential, Company Confidential, Airflow, Company Confidential, Python, and AWS. Design and development of a universal data platform for global Company Confidential companies. This Azure and Company Confidential powered initiative combines diverse Company Confidential and Company Confidential data sources. The data platform is at the early stages of the development, covering design of architecture and processes as Company Confidential as giving Company Confidential for technology selection. Centralized reporting platform for a growing US telecommunications company. This project involves implementing BigQuery and Looker as the central platform for data reporting. It focuses on centralizing data, integrating various CRMs, and building executive reporting solutions to support decision-making and business Company Confidential. 🚀 Your main responsibilities Company Confidential and maintain a high-Company Confidential data processing platform for automotive data, ensuring scalability and reliability. Design and implement data pipelines that Company Confidential large volumes of data in both streaming and batch modes. Optimize data workflows to ensure efficient data ingestion, processing, and storage using technologies such as Company Confidential, Company Confidential, and Airflow. Work with data lake technologies (e.g., Company Confidential) to manage Company Confidential and Company Confidential data Company Confidential. Collaborate with cross-functional teams to understand data requirements and ensure Company Confidential integration of data sources. Monitor and troubleshoot the platform, ensuring high availability, Company Confidential, and Company Confidential of data processing. Company Confidential Company Confidential services (AWS) for infrastructure management and scaling of processing workloads. Write and maintain high-Company Confidential Python (or Java/Company Confidential) Company Confidential for data processing tasks and automation. Requirements 🎯 What you'll need to succeed in this role At least 4 years of Company Confidential experience implementing, developing, or maintaining Big Data systems, data governance and data management processes. Strong programming skills in Python (or Java/Company Confidential) writing a clean Company Confidential, OOP design. Hands-on with Big Data technologies like Company Confidential , Company Confidential, Kafka, Data Platform, Airflow, NiFi, Company Confidential, and Company Confidential. Excellent understanding of Company Confidential data and data modeling techniques. Experience implementing and deploying solutions in Company Confidential environments. Consulting experience with excellent communication and Company Confidential management skills, including prior experience directly interacting with clients as a consultant. Ability to work independently and take ownership of project deliverables. Company Confidential English (at least Company Confidential level). Bachelor’s degree in technical or mathematical studies. ➕ Company Confidential to have Experience with an MLOps Company Confidential such as Kubeflow or MLFlow. Familiarity with Company Confidential and/or dbt. 🎁 Discover our perks & benefits Work in a supportive team of passionate enthusiasts of AI & Big Data. Engage with top-tier global enterprises and cutting-edge startups on international Company Confidential. Enjoy flexible work arrangements, allowing you to work Company Confidential or from modern offices and coworking spaces. Accelerate your Company Confidential Company Confidential through career paths , knowledge-sharing initiatives, language classes, and sponsored training or conferences , including a partnership with Company Confidential , which offers industry-leading training materials and certifications. Choose your preferred Company Confidential of cooperation B2B or a contract of mandate, and Company Confidential use of 20 fully Company Confidential days off. Participate in team-building events and utilize the integration budget . Celebrate work anniversaries, birthdays, and milestones. Company Confidential medical and sports packages , eye care, and Company Confidential-being support services, including psychotherapy and coaching. Get full work equipment for Company Confidential productivity, including a laptop and other necessary devices. With our backing, you can Company Confidential your personal Company Confidential by speaking at conferences, writing for our blog, or participating in meetups. Experience a smooth Company Confidential with a dedicated buddy, and start your Company Confidential in our friendly, supportive, and autonomous culture. Originally posted on Himalayas Apply To This Job