Next Ventures

Data Engineer (Databricks preferred) - Edison

Edison, New Jersey
We have delivered technology recruitment & consultancy across all industries meeting enterprise needs since 2001.

Job Description

Data Engineer (Databricks preferred)

Posted: Thursday, 2/13/2025

Onsite contract in Edison NJ area (4x per week)

Long term contract: 3 year commitment

Rate: 80-100/Hour USD

Previous experience working in Finance, ideally Capital Markets, required.

We’re looking for an experienced Data Engineer to join our client's team and drive the development of cutting-edge data solutions. If you have a passion for optimizing big data pipelines, working with cloud platforms, and delivering high-impact insights, this role is for you!

What You’ll Do:

  • Design and build scalable data pipelines for seamless ingestion, transformation, and integration across diverse sources.

  • Develop and optimize Spark applications in Databricks to process and analyze large datasets efficiently.

  • Implement Delta Lake, data modeling, and cloud-based warehousing solutions.

  • Write clean, efficient code in Python, SQL, and PySpark to support data processing needs.

  • Work with structured, semi-structured, and unstructured data in event-driven and streaming environments.

  • Ensure high performance and scalability of Databricks workloads, while troubleshooting and optimizing jobs.

  • Enforce best practices in data governance, security, and compliance across cloud-based platforms.

  • Conduct code reviews to ensure optimal execution and adherence to industry standards.

Must-Have Skills:

  • Expertise in Databricks & Snowflake

  • Advanced SQL & Python development

  • Hands-on experience with ADF & PySpark

  • Strong Data Warehouse architecture & modeling knowledge

Preferred Experience:

  • 8+ years of Python and SQL coding experience

  • ETL development using Databricks and PySpark

  • Familiarity with cloud data warehouses (Synapse, BigQuery, Redshift, Snowflake)

  • OLTP & OLAP, Dimensional Data Modeling expertise

  • Experience leading cloud data migrations and architecting scalable solutions

  • Cloud certifications are a plus!

Apply Now

Classet is a skilled trades network. Once you have applied, A Classet recruiter will reach out within 24 hours to learn more about your career search! Classet helps everyone from experienced crafstmen & women to eager apprentices find new opportunities. We are here to help you find the right fit for your career.