Data Engineer (Databricks Experience) Job at Infinitive Inc, McLean, VA

UVkyaDZ3N3k5U0lQZkE0YlJpUWJSRUp6aGc9PQ==
  • Infinitive Inc
  • McLean, VA

Job Description

*Candidates must be local to the Washington D.C. metro area. 

About Infinitive:

Infinitive is a data and AI consultancy that enables its clients to modernize, monetize and operationalize their data to create lasting and substantial value. We possess deep industry and technology expertise to drive and sustain adoption of new capabilities. We match our people and personalities to our clients' culture while bringing the right mix of talent and skills to enable high return on investment.

Infinitive has been named “Best Small Firms to Work For” by Consulting Magazine 6 times most recently in 2023. Infinitive has also been named a Washington Post “Top Workplace”, Washington Business Journal “Best Places to Work”, and Virginia Business “Best Places to Work.”

About the Role:
We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with expertise in Databricks, DevOps tools (Jenkins/Terraform), and data modeling concepts (3NF, Dimensional, Data Vault). As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining our client's data infrastructure while ensuring scalability, reliability, and efficiency.

 

Responsibilities:

  1. Data Engineering: Design, build, and maintain scalable data pipelines and ETL processes using Databricks and other relevant technologies.

  2. DevOps Integration: Implement continuous integration and continuous deployment (CI/CD) pipelines using Jenkins and Terraform to automate deployment, monitoring, and scaling of data infrastructure.

  3. Data Modeling: Develop and implement data models based on business requirements, including 3NF, Dimensional, and Data Vault models. Ensure data models adhere to best practices for efficiency, scalability, and maintainability.

  4. Performance Optimization: Identify and address performance bottlenecks in data pipelines and queries. Optimize data processing and storage to improve overall system performance.

  5. Data Quality Assurance: Implement data quality checks and monitoring processes to ensure data accuracy, completeness, and consistency.

  6. Collaboration: Work closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver high-quality solutions.

  7. Documentation and Best Practices: Document data pipelines, infrastructure configurations, and data models. Define and enforce best practices for data engineering and DevOps processes.

  8. Training and Mentorship: Provide guidance and mentorship to junior team members. Conduct training sessions to promote knowledge sharing and skill development within the team.

Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or related field. Master’s degree preferred.
  • Proven experience as a Data Engineer, preferably in a cloud-based environment.
  • Strong proficiency in Databricks for data processing and analytics.
  • Hands-on experience with DevOps tools such as Jenkins and Terraform for infrastructure automation.
  • In-depth knowledge of data modeling concepts including 3NF, Dimensional, and Data Vault.
  • Proficiency in SQL and programming languages such as Python or Scala.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


Applicants for employment in the U.S. must possess work authorization which does not require sponsorship by the employer for a visa.

Infinitive is an Equal Opportunity Employer.

Job Tags

Full time, Local area,

Similar Jobs

Harper College

Student Aide - Fashion Design | Harper College Job at Harper College

 ...Friday. Assist the Fashion program and its students with various duties in the lab and classroom...  ...this position, you must be a current FAS Harper College student and enrolled in at least 6 credits per semester (3 in the summer semester). Experience Requirements: The... 

iSoftTek Solutions Inc

Databricks Platform Administrator Job at iSoftTek Solutions Inc

 ...Databricks Platform Administrator Primary Skill: Data Analysis Location: Atlanta, GA Job Type: W2 Duration: 12 Months Job Description: Responsibilities will include designing, implementing, and maintaining the Databricks platform, and providing operational... 

NITELINES USA, INC

Licensed Social Worker/ Licensed Professional Counselor (1099) Job at NITELINES USA, INC

 ...Licensed Social Worker/ Licensed Professional Counselor/Licensed Marriage and Family Therapist(1099) Pay rate: $47.00 hr (1099) Duration: 3 Months Job Location: Territorial Correctional Facility, 275 US-50, Canon City, CO, 81215 Hours: Mon - Fri 8 A - 5P... 

Frost PLLC

Campus Recruiter Job at Frost PLLC

 ...Join Our Team as a Campus Recruiter! The Opportunity: Are you passionate about connecting with emerging talent and making an impact? As our Campus Recruiter, you'll play a key role in shaping the future of our organization by identifying and engaging the... 

BrightPath Kids USA

Child Care Assistant Teacher - New Center! Job at BrightPath Kids USA

 ...community of over 5,000 dedicated employees, and experience competitive pay and benefits, including a...  ...home away from home for children in our care, according to NAEYC guidelines....  ...communication with parents/guardians about their child. Top Reasons to join BrightPath Kids:...