NewarkCARecruiter Since 2001
the smart solution for Newark jobs

Sr. Data Engineer

Company: The Judge Group
Location: Newark
Posted on: January 12, 2021

Job Description:

Apply Now Posted : November 6, 2020 Job Type : Permanent Category : Information TechnologyDescription Our client is currently seeking a Sr. Data Engineer Data Engineer and BI : IOT Tools - MQTT, Kafka, Apache Spark and data frameLanguages: Java, PythonTechnical/Functional Skills -MUST HAVE SKILLS --- 6 years of experience in Data Engineering and Business Intelligence. --- Proficient in IoT tools such as MQTT, Kafka, Spark --- Proficient with AWS, S3, Redshift --- Experience with Presto and Parquet/ORC --- Proficient with Apache Spark and data frame. --- Experienced in containerization, including Docker and Kubernetes --- Expert in tools such as Apache Spark, Apache Airflow, Presto --- Expert in design and implement reliable, scalable, and performant distributed systems and data pipelines --- Extensive programming and software engineering experience, especially in Java, Python, --- Experience with Columnar database such as Redshift, Vertica Roles & Responsibilities --- Hands-on design and develop streaming and IoT data pipelines. --- Developing streaming pipeline using MQTT, Kafka, Spark Structure Streaming --- Orchestrate and monitor pipelines using Prometheus and Kubernetes --- Deploy and maintain streaming jobs in CI/CD and relevant tools. --- Python scripting for automation and application development --- Design and implement Apache Airflow and other dependency enforcement and scheduling tools. --- Hands-on data modeling and data warehousing --- Deploy solution using AWS, S3, Redshift and Docker/Kubernetes --- Develop storage and retrieval system using Presto and Parquet/ORC

Keywords: The Judge Group, Newark , Sr. Data Engineer, Other , Newark, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Other Jobs


Get New Siding Work Today - Preview Leads In Your Area
Description: Over 25 million homeowners have trusted HomeAdvisor 1800Contractor to help them find quality professionals with the expertise to turn their home improvement
Company: HomeAdvisor
Location: San Rafael
Posted on: 01/23/2021

Assistant Teacher - Pre-K
Description: Be a difference maker, with Learning Care Group. We are a community of collaborative, bold, fun, dedicated individuals, whose passion is the many children we guide, teach, and protect every day. As early (more...)
Company: La Petite Academy
Location: San Ramon
Posted on: 01/23/2021

No Vehicle Required - Deliver with DoorDash on our e-bikes
Description: Want to earn money, but don't have a car Deliver with DoorDash. We'll even set you up with an e-bike br What is DoorDash br Available in over 4,000 cities in the U.S., Canada, and Australia, (more...)
Company: Doordash
Location: San Bruno
Posted on: 01/23/2021


Bilingual Parts Delivery
Description: br br xa0 Nuestros conductores de Entrega de Partes proporcionan un excelente servicio al cliente a trav xe9 s de la entrega segura y eficiente de partes y productos a nuestros clientes profesionales (more...)
Company: O'Reilly Auto Parts
Location: Santa Cruz
Posted on: 01/23/2021

Now Hiring Security Guards in your area
Description: Job Description Now Hiring Security Guards in your area Hiring Immediately
Company: Advantage Solutions
Location: San Ramon
Posted on: 01/23/2021

Customer Service Representative
Description: We are seeking Customer Service - Authorization Agents to support a Home Warranty organization located in San Ramon, CA This position starts out as a temp-to-hire and will convert to a full-time employee (more...)
Company: Kelly
Location: San Ramon
Posted on: 01/23/2021

Security Guards - Hiring Immediately!
Description: Job DescriptionSecurity Guards - Hiring Immediately The COVID-19 pandemic has resulted in increased security needs for
Company: Advantage Solutions
Location: San Ramon
Posted on: 01/23/2021

Bilingual Parts Delivery
Description: xa0 Nuestros conductores de Entrega de Partes proporcionan un excelente servicio al cliente a trav xe9 s de la entrega segura y eficiente de partes y productos a nuestros clientes profesionales utilizando (more...)
Company: O'Reilly Auto Parts
Location: Santa Cruz
Posted on: 01/23/2021

Resident Assistant (RA Memory Care) - San Rafael
Description: Req ID 2 br Job Category Clinical Services br Shift NOC br Who We Are br br An Elder Care Alliance Community br br AlmaVia of San Rafael br br Do you enjoy working with seniors Do you (more...)
Company: Elder Care Alliance
Location: San Rafael
Posted on: 01/23/2021

Lead Teacher - Pre-K
Description: Be a difference maker, with Learning Care Group. We are a community of collaborative, bold, fun, dedicated individuals, whose passion is the many children we guide, teach, and protect every day. As early (more...)
Company: La Petite Academy
Location: San Ramon
Posted on: 01/23/2021

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Newark RSS job feeds