(IND-Pune) Data Engineer
Pune, Maharashtra 1 month ago
Job Description
**DESCRIPTION**
The Data Engineer supports, develops, and maintains a data and analytics platform to efficiently process, store, and make data available to analysts and other consumers. This role collaborates with Business and IT teams to understand requirements and best leverage technologies for agile data delivery at scale.
**Note:- Even though the role is categorized as Remote, it will follow a hybrid work model.**
**Key Responsibilities:**
+ Implement and automate deployment of distributed systems for ingesting and transforming data from various sources (relational, event-based, unstructured).
+ Develop and operate large-scale data storage and processing solutions using cloud-based platforms (e.g., Data Lakes, Hadoop, HBase, Cassandra, MongoDB, DynamoDB).
+ Ensure data quality and integrity through continuous monitoring and troubleshooting.
+ Implement data governance processes, managing metadata, access, and data retention.
+ Develop scalable, efficient, and quality data pipelines with monitoring and alert mechanisms.
+ Design and implement physical data models and storage architectures based on best practices.
+ Analyze complex data elements and systems, data flow, dependencies, and relationships to contribute to conceptual, physical, and logical data models.
+ Participate in testing and troubleshooting of data pipelines.
+ Utilize agile development technologies such as DevOps, Scrum, and Kanban for continuous improvement in data-driven applications.
**RESPONSIBILITIES**
**Qualifications, Skills, and Experience:**
**Must-Have:**
+ 2-3 years of experience in data engineering with expertise in Azure Databricks and Scala/Python.
+ Hands-on experience with Spark (Scala/PySpark) and SQL.
+ Strong understanding of SPARK Streaming, SPARK Internals, and Query Optimization.
+ Proficiency in Azure Cloud Services.
+ Agile Development experience.
+ Experience in Unit Testing of ETL pipelines.
+ Expertise in creating ETL pipelines integrating ML models.
+ Knowledge of Big Data storage strategies (optimization and performance).
+ Strong problem-solving skills.
+ Basic understanding of Data Models (SQL/NoSQL) including Delta Lake or Lakehouse.
+ Exposure to Agile software development methodologies.
+ Quick learner with adaptability to new technologies.
**Nice-to-Have:**
+ Understanding of the ML lifecycle.
+ Exposure to Big Data open-source technologies.
+ Experience with clustered compute cloud-based implementations.
+ Familiarity with developing applications requiring large file movement in cloud environments.
+ Experience in building analytical solutions.
+ Exposure to IoT technology.
**Competencies:**
+ **System Requirements Engineering:** Translates stakeholder needs into verifiable requirements.
+ **Collaborates:** Builds partnerships and works collaboratively with others.
+ **Communicates Effectively:** Develops and delivers clear communications for various audiences.
+ **Customer Focus:** Builds strong customer relationships and delivers customer-centric solutions.
+ **Decision Quality:** Makes timely and informed decisions to drive progress.
+ **Data Extraction:** Performs ETL activities from various sources using appropriate tools and technologies.
+ **Programming:** Writes and tests computer code using industry standards, tools, and automation.
+ **Quality Assurance Metrics:** Applies measurement science to assess solution effectiveness.
+ **Solution Documentation:** Documents and communicates solutions to enable knowledge transfer.
+ **Solution Validation Testing:** Ensures configuration changes meet design and customer requirements.
+ **Data Quality:** Identifies and corrects data flaws to support governance and decision-making.
+ **Problem Solving:** Uses systematic analysis to identify and resolve issues effectively.
+ **Values Differences:** Recognizes and values diverse perspectives and cultures.
**QUALIFICATIONS**
**Education, Licenses, and Certifications:**
+ College, university, or equivalent degree in a relevant technical discipline, or equivalent experience required.
+ This position may require licensing for compliance with export controls or sanctions regulations.
**Work Schedule:**
+ Work primarily with stakeholders in the US, requiring a 2-3 hour overlap during EST hours as needed.
**Job** Systems/Information Technology
**Organization** Cummins Inc.
**Role Category** Remote
**Job Type** Exempt - Experienced
**ReqID** 2411641
**Relocation Package** No
Rotary Equipment Engineer (Pune, MH, IN, 411001)
Pune, Maharashtra 4 hours ago
The Lubrizol Corporation, a Berkshire Hathaway company, is a specialty chemical company whose science delivers sustainable solutions to advance mobility, improve wellbeing and enhance modern life. Founded in 1928, Lubrizol owns and operates more than...
(IND-Pune) Product Design Technician - Level II
Pune, Maharashtra 1 day ago
**DESCRIPTION** **Job Summary:** Creates and maintains specifications (drawings and models) of Cummins products per company, industry, national, and international standards, while positively impacting the organization's performance. **Key...
(IND-Pune) Supply Chain Planner
Pune, Maharashtra 1 day ago
**DESCRIPTION** To plan and maintain daily Supply Chain operations in one or more functional areas such as materials, production, inventory, logistics, customer service, demand management, or order fulfillment. Ensures internal and external...
(IND-Pune) Data Analyst
Pune, Maharashtra 1 day ago
**DESCRIPTION** **Key Responsibilities:** + Conduct descriptive and diagnostic analytics on data sources. + Apply machine learning tools on data and metadata to improve data quality. + Identify patterns and trends in data sets. + Create reports and...
(IND-Pune) Facilities Engineer
Pune, Maharashtra 1 day ago
**DESCRIPTION** Assists with the maintenance and repairs of plant equipment, buildings, and grounds. Monitors the functioning of building systems including electrical, HVAC, structural, mechanical, fire/life safety, etc. Leads project management and...
(IND-Chennai) Online Fraud Protection Engineer
Chennai, Tamil Nadu 2 days ago
**Online Fraud Protection Engineer** We are the world’s learning company with more than 24,000 employees operating in 70 countries. We combine world-class educational content and assessment, powered by services and technology, to enable more...
(IND-Pune) IT Technical Analyst
Pune, Maharashtra 3 days ago
**DESCRIPTION** **Key Responsibilities:** + Contribute to the creation of technical specifications for applications, infrastructure, or complete solutions. + Assist in technical analysis of potential solutions, evaluating the technical fit and...
(IND-Pune) Customer Order Management Specialist
Pune, Maharashtra 3 days ago
**DESCRIPTION** Key Responsibilities: + **Order Management** : Perform order management tasks for a specific set of customers/accounts, handling the entire order life cycle (order entry, order modification, invoicing, credits/debits, logistics...
(IND-Pune) Supplier Quality Engineer - Senior
Pune, Maharashtra 3 days ago
**DESCRIPTION** **Key Responsibilities:** + Build strong relationships with all critical partners to improve quality and business outcomes, including external suppliers, external customers, and internal customers and stakeholders such as Purchasing,...
(IND-Pune) Customer Engineering Product Specialist
Pune, Maharashtra 3 days ago
**DESCRIPTION** GPP Database Link (https://cummins365.sharepoint.com/sites/CS38534/) **Job Summary:** This dual customer/product focused position serves as the senior technical liaison between OEMs and represents our customers during new product...