Sr. Data Engineer
Company: The Judge Group
Location: Newark
Posted on: January 12, 2021
|
|
Job Description:
Apply Now Posted : November 6, 2020 Job Type : Permanent
Category : Information TechnologyDescription Our client is
currently seeking a Sr. Data Engineer Data Engineer and BI : IOT
Tools - MQTT, Kafka, Apache Spark and data frameLanguages: Java,
PythonTechnical/Functional Skills -MUST HAVE SKILLS --- 6 years of
experience in Data Engineering and Business Intelligence. ---
Proficient in IoT tools such as MQTT, Kafka, Spark --- Proficient
with AWS, S3, Redshift --- Experience with Presto and Parquet/ORC
--- Proficient with Apache Spark and data frame. --- Experienced in
containerization, including Docker and Kubernetes --- Expert in
tools such as Apache Spark, Apache Airflow, Presto --- Expert in
design and implement reliable, scalable, and performant distributed
systems and data pipelines --- Extensive programming and software
engineering experience, especially in Java, Python, --- Experience
with Columnar database such as Redshift, Vertica Roles &
Responsibilities --- Hands-on design and develop streaming and IoT
data pipelines. --- Developing streaming pipeline using MQTT,
Kafka, Spark Structure Streaming --- Orchestrate and monitor
pipelines using Prometheus and Kubernetes --- Deploy and maintain
streaming jobs in CI/CD and relevant tools. --- Python scripting
for automation and application development --- Design and implement
Apache Airflow and other dependency enforcement and scheduling
tools. --- Hands-on data modeling and data warehousing --- Deploy
solution using AWS, S3, Redshift and Docker/Kubernetes --- Develop
storage and retrieval system using Presto and Parquet/ORC
Keywords: The Judge Group, Newark , Sr. Data Engineer, Other , Newark, California
Click
here to apply!
|
Didn't find what you're looking for? Search again!
Other Other JobsGet New Siding Work Today - Preview Leads In Your Area Description: Over 25 million homeowners have trusted HomeAdvisor 1800Contractor to help them find quality professionals with the expertise to turn their home improvement Company: HomeAdvisor Location: San Rafael Posted on: 01/23/2021 Assistant Teacher - Pre-K Description: Be a difference maker, with Learning Care Group. We are a community of collaborative, bold, fun, dedicated individuals, whose passion is the many children we guide, teach, and protect every day. As early (more...) Company: La Petite Academy Location: San Ramon Posted on: 01/23/2021 No Vehicle Required - Deliver with DoorDash on our e-bikes Description: Want to earn money, but don't have a car Deliver with DoorDash. We'll even set you up with an e-bike br What is DoorDash br Available in over 4,000 cities in the U.S., Canada, and Australia, (more...) Company: Doordash Location: San Bruno Posted on: 01/23/2021 Bilingual Parts Delivery Description: br br xa0 Nuestros conductores de Entrega de Partes proporcionan un excelente servicio al cliente a trav xe9 s de la entrega segura y eficiente de partes y productos a nuestros clientes profesionales (more...) Company: O'Reilly Auto Parts Location: Santa Cruz Posted on: 01/23/2021 Now Hiring Security Guards in your area Description: Job Description Now Hiring Security Guards in your area Hiring Immediately Company: Advantage Solutions Location: San Ramon Posted on: 01/23/2021 Customer Service Representative Description: We are seeking Customer Service - Authorization Agents to support a Home Warranty organization located in San Ramon, CA This position starts out as a temp-to-hire and will convert to a full-time employee (more...) Company: Kelly Location: San Ramon Posted on: 01/23/2021 Security Guards - Hiring Immediately! Description: Job DescriptionSecurity Guards - Hiring Immediately The COVID-19 pandemic has resulted in increased security needs for Company: Advantage Solutions Location: San Ramon Posted on: 01/23/2021 Bilingual Parts Delivery Description: xa0 Nuestros conductores de Entrega de Partes proporcionan un excelente servicio al cliente a trav xe9 s de la entrega segura y eficiente de partes y productos a nuestros clientes profesionales utilizando (more...) Company: O'Reilly Auto Parts Location: Santa Cruz Posted on: 01/23/2021 Resident Assistant (RA Memory Care) - San Rafael Description: Req ID 2 br Job Category Clinical Services br Shift NOC br Who We Are br br An Elder Care Alliance Community br br AlmaVia of San Rafael br br Do you enjoy working with seniors Do you (more...) Company: Elder Care Alliance Location: San Rafael Posted on: 01/23/2021 Lead Teacher - Pre-K Description: Be a difference maker, with Learning Care Group. We are a community of collaborative, bold, fun, dedicated individuals, whose passion is the many children we guide, teach, and protect every day. As early (more...) Company: La Petite Academy Location: San Ramon Posted on: 01/23/2021 |