Lead Data Engineer Job at MSR Cosmos, San Jose, CA

ZGlwRE1YUkkxWlp6MWdnZjJzYnJhbVJ2T0E9PQ==
  • MSR Cosmos
  • San Jose, CA

Job Description

Greetings!

This is Rakesh from MSRCOSMOS LLC .

We are one of the leading staffing agency in North America. I am reaching out to check your availability for the below role. Please review the job description and let me know if you are interested to submit your resume. You can share your resume to rakesh.reddy@msrcosmos.com

Job Title: Data Engineer Lead

Location: San Jose, CA (Only Locals)

Duration: Long term contract

Educational Qualification*

Bachelor's degree in Computer Science, Information Systems, or a related field.

Job Description of Role* (RNR)
(Mandatory - Minimum 500 words)

Overview:

We are looking for a skilled Technical Lead to oversee the design and implementation of large-scale data engineering and migration projects. The ideal candidate will have hands-on expertise in Databricks, Azure Data Factory, and related technologies, with a proven track record of leading at least 3 successful data projects.

Experience Required:

Minimum of 12 years of experience in data engineering and architecture roles.
Must have led 3 or more end-to-end enterprise data projects, Databricks, and Azure technologies.

Primary (Must have skills)*

Primary Skills:

Deep knowledge of architecture and complex data models

Extensive experience with Databricks, PySpark, Spark SQL , and Delta Lake.
Strong command over ETL tools such as Data Services and Azure Data Factory.
Proficient in programming languages: Python, Java, or Scala.
Hands-on with Azure cloud services including networking and security configurations.



Key Responsibilities :
1. Lead the design and implementation of ETL solutions using Azure Data Factory.
2. Guide and mentor team members on data engineering best practices.
3. Develop and maintain complex ETL pipelines using Python, Java, or Scala.
4. Ensure high-quality, secure, and performant data migrations using Azure Blob Storage and Spark JDBC.
5. Drive collaboration across teams to implement advanced analytics and ML models in Databricks.
6. Identify and resolve performance bottlenecks and network-related issues.
7. Ensure adherence to data governance and compliance standards across all data flows.

Expierence Range

10+ Years

Secondary Skills (Good To have)*

Secondary Skills:
Understanding of Databricks ML and analytics tools.
Experience resolving networking/VPN issues related to data flow.
Familiarity with data governance, security, and compliance frameworks.
Experience in setting up CI/CD pipelines and using DevOps tools is a plus.

Soft skills/other skills (If any)

Analytical Skills: Strong analytical and problem-solving skills, with the ability to interpret complex data sets and derive meaningful insights

Communication Skills: Excellent verbal and written communication skills, with the ability to convey technical information to non-technical stakeholders

Leadership Skills: Proven ability to lead and manage teams, with a track record of successful project delivery.

Presentation Skills : Effectively presenting project updates and outcomes to stakeholders and executives.

Job Tags

Long term contract, Local area,

Similar Jobs

Gulfstream Strategic Placements

Ammonia Refrigeration Technician Job at Gulfstream Strategic Placements

 ...Job Title: Ammonia Refrigeration Technician Location: Los Angeles, CA Job Type: Full-Time Job Summary We seek a skilled and...  ...is responsible for operating, maintaining, and repairing industrial ammonia (NH3) refrigeration systems. The ideal candidate will... 

The Good Seed CDC

Access Phone Distributor Job at The Good Seed CDC

 ...Job Title: Access/Lifeline Phone Distributor Location: Los Angeles, CA Compensation...  ...potential clients as needed. Work independently to meet and exceed enrollment targets....  ...the potential for high earnings. Opportunity to make a significant impact in your... 

Domino's Franchise

Delivery Driver - 3725 S. Carrier Parkway, Suite Job at Domino's Franchise

Job Description REQUIREMENTS FOR THE JOB Must be 18 years of age with a valid driver's license, safe driving record and 1 years of driving history. Maintain current vehicle insurance and vehicle must pass regular safety inspections. Outstanding customer...

Cornerstone VNA

Hospice CNA ( Certified Nursing Assistant ) Job at Cornerstone VNA

About Us Founded in 1913, Cornerstone Visiting Nurse Association is an independent nonprofit home, health and hospice organization...  ...what it is today. Job Description: The Licensed nursing assistant (LNA or CNA) will work under the supervision of a licensed nurse... 

Pure Freight Lines, LTD.

Owner Operator/Class A Team Driver Job at Pure Freight Lines, LTD.

 ...OTR Team Class A Owner Operators We have Less Deductions for Owners at PURE! Compensation & Benefits:~80/20 Split~ Teams...  ...Illinois-based transportation and logistics company is looking for safety-concious, experienced truck drivers and owner-operators....