BradentonRecruiter Since 2001
the smart solution for Bradenton jobs

Data Engineer - Hadoop/Spark

Company: Future Focus Infotech pvt ltd
Location: Bradenton
Posted on: August 16, 2019

Job Description:

Job Title: Data Engineer - Hadoop/Spark Location: Boynton Beach,FL & Bradenton, FL Duration: 6 months JD: BigData and Hadoop Ecosystems, Microsoft Azure, Python, Apache & Spark, Kafka, Scala Essential Skills: The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources. The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports. The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with. Skill Need so Expertise working with large scale distributed systems (Hadoop, Spark Strong understanding of the big data cluster, and its architectureo Experience building and optimizing big data ETL pipelines.o Advanced programming skills with Python, Java, Scala Good knowledge of spark internals and performance tuning of spark jobs. Strong SQL skills and is comfortable operating with relational data models and structure. Capable of accessing data via a variety of API/RESTful services. Experience with messaging systems like Kafka. Experience with No SQL databases. Neo4j, mongo, etc. Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications. Exposure to cloud environments and architectures. (preferably Azure)o Ability to work collaboratively with other teams. Experience with containerization using tools such as Docker. Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows. Advanced understanding of software development and collaboration, including experience with tools such as Git. Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. Essential Responsibilities include but not limited to Design and develop ETL workflows to migrate data from varied data sources including SQL Server, Netezza, Kafka etc. in batch and real-time. Develop checks and balances to ensure integrity of the ingested data. Design and Develop Spark jobs as per requirements for data processing needs. Work with Analysts and Data Scientists to assist them in building scalable data products. Designs systems, alerts, and dashboards to monitor data products in production

Keywords: Future Focus Infotech pvt ltd, Bradenton , Data Engineer - Hadoop/Spark, Engineering , Bradenton, Florida

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Commercial Laundry Engineer - Walt Disney World Swan & Dolphin Resort - Sheraton Hotels - (19075327)
Description: Here's To Your Journey with Sheraton At Sheraton, we go above and beyond in everything we do. We are inspired by our guests and one another and are driven to make things better. We love what we do, and (more...)
Company: Marriott International
Location: Kissimmee
Posted on: 08/20/2019

Senior Project Engineer
Description: IF YOU ARE INTERESTED IN THIS POSITION PLEASE APPLY DIRECTLY ON OUR WEBSITE AT: http://jobs.ourcareerpages.com/job/267000 source BalfourBeattyCareers jobFeedCode BalfourBeattyCareers returnURL https://www.balfourbeattyus.com/ (more...)
Company: Balfour Beatty
Location: Kissimmee
Posted on: 08/20/2019

Design Engineer
Description: Permanent position: Growing manufacturer is seeking multiple, Design Engineers. These positions will be on first shift and are located near the Clearwater, Florida area. The Design Engineers must have (more...)
Company: Randstad Engineering
Location: Clearwater
Posted on: 08/19/2019


Sheet Metal Mechanics and Top Helpers
Description: Now Hiring experienced commercial sheet metal mechanics and helpers. Apply today and start tomorrow CCS understands and appreciates the value of America s Skilled Tradespeople. Join us and we ll team (more...)
Company: CCS Construction
Location: Brandon
Posted on: 08/20/2019

Senior Tactical Hardware Engineer (SOCOM) with Security Clearance
Description: Duties and Responsibilities: br - Lead hardware engineer responsible for the IT hardware infrastructure to include design, integration, and testing of Tactical Local Area Network TACLAN baseline releases. (more...)
Company: Seneca Nation Group
Location: Tampa
Posted on: 08/19/2019

Engineering apprentice
Description: This fast paced life saving manufacturing company in the St. Petersburg area is looking for an engineering apprentice. Are you a currently obtaining a degree Are you in the process of completing technical (more...)
Company: Randstad
Location: Saint Petersburg
Posted on: 08/19/2019

Civil-Structural (Forensic) Engineer (PE required)
Description: This position requires a professional engineers license PE in the State of Florida. A NCEES
Company: Stephens Engineering Consultants, Inc.
Location: Tampa
Posted on: 08/19/2019

Cisco Voice Engineer
Description: Description Job Requisition Cisco Voice Engineer Job Description Global Information Grid GIG Service Management-Operations GSM-O , a Defense Group of Leidos has an opening for a Cisco Voice Engineer. (more...)
Company: Leidos
Location: Tampa
Posted on: 08/19/2019

Mulesoft Integration Engineer
Description: Amgen is seeking an experienced MuleSoft Integration Engineer to join the multi-site Research Development Informatics organization. The ideal engineer will have a passion for developing and maintaining (more...)
Company: Amgen
Location: Tampa
Posted on: 08/19/2019

Field Technician, Locator, Tampa, FL
Description: Position br Field Technician, Locator, Tampa, FL br br Req Code br 1548 br br Location br Tampa, FL br br Full Time br Yes br br Duties br br br Key Responsibilities and (more...)
Company: Heath Consultants Incorporated
Location: Tampa
Posted on: 08/19/2019

Log In or Create An Account

Get the latest Florida jobs by following @recnetFL on Twitter!

Bradenton RSS job feeds