the smart solution for Bradenton jobs

Data Engineer - Hadoop/Spark

Company: Future Focus Infotech pvt ltd
Location: Bradenton
Posted on: March 11, 2019

Job Description:

Job Title: Data Engineer - Hadoop/Spark Location: Boynton Beach,FL & Bradenton, FL Duration: 6 months JD: BigData and Hadoop Ecosystems, Microsoft Azure, Python, Apache & Spark, Kafka, Scala Essential Skills: The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources. The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports. The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with. Skill Need so Expertise working with large scale distributed systems (Hadoop, Spark Strong understanding of the big data cluster, and its architectureo Experience building and optimizing big data ETL pipelines.o Advanced programming skills with Python, Java, Scala Good knowledge of spark internals and performance tuning of spark jobs. Strong SQL skills and is comfortable operating with relational data models and structure. Capable of accessing data via a variety of API/RESTful services. Experience with messaging systems like Kafka. Experience with No SQL databases. Neo4j, mongo, etc. Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications. Exposure to cloud environments and architectures. (preferably Azure)o Ability to work collaboratively with other teams. Experience with containerization using tools such as Docker. Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows. Advanced understanding of software development and collaboration, including experience with tools such as Git. Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. Essential Responsibilities include but not limited to Design and develop ETL workflows to migrate data from varied data sources including SQL Server, Netezza, Kafka etc. in batch and real-time. Develop checks and balances to ensure integrity of the ingested data. Design and Develop Spark jobs as per requirements for data processing needs. Work with Analysts and Data Scientists to assist them in building scalable data products. Designs systems, alerts, and dashboards to monitor data products in production

Keywords: Future Focus Infotech pvt ltd, Bradenton , Data Engineer - Hadoop/Spark, Engineering , Bradenton, Florida

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Description: To connect with a recruiter on Driver and Technician careers, text ADS to 44844 br br POSITION SUMMARY: br br General Daily Duties: Perform preventive maintenance and scheduled maintenance repairs (more...)
Company: Advanced Disposal
Location: Kissimmee
Posted on: 03/19/2019

Sr. Project Engineer - Pool & Spa Industry
Description: We are hiring for a Senior Project Engineer Responsibilities Assist with the develpment of product or equipment specifications, performance requirements, and component desiggns that can be produced by (more...)
Company: NetHire
Location: Saint Petersburg
Posted on: 03/19/2019

Security Engineer, Cloud Security Specialist
Description: Amgen is searching for a Senior Associate IS Security Engineer, Cloud Security Specialist, who will report to the Senior Manager Information Systems and will be based in Tampa, FL, at Amgen's new Capability (more...)
Company: Amgen
Location: Tampa
Posted on: 03/17/2019

Diesel Mechanic - Heavy Trucks - KTC
Description: mechanic service trucks trucking br br KENAN TRANSPORT , a highway subsidiary of the Kenan Advantage Group , is now seeking Mechanics out of Tampa, Florida. Apply today Advantages
Company: Kenan Transport Company
Location: Tampa
Posted on: 03/19/2019

Building Engineer II Pool Tech/Operator - JW Marriott Marco Island Beach Resort - (1900081K)
Description: Here's To Your Journey with JW Marriott Marriott International portfolio of brands includes both JW Marriott and Marriott Hotels.Marriott Hotels, Marriott International''s flagship brand with more than (more...)
Company: Marriott International, Inc.
Location: Bonita Springs
Posted on: 03/17/2019

Casting Engineer
Description: A Casting Engineer job in Tampa, FL is currently available through Belcan at one of our aerospace clients. Qualified candidates must have a Bachelor's degree in Engineering and at least three years of (more...)
Company: Belcan Corporation
Location: Tampa
Posted on: 03/19/2019

Lead Technician in St. Petersburg, Florida - Careers at Shop 290-Charter St Petersburg
Description: Position Summary The Lead Technician will be responsible for timely repair and maintenance of light, medium, or heavy duty vehicles to ensure a safe and efficient fleet of vehicles as well as managing (more...)
Company: Amerit Fleet Solutions
Location: Saint Petersburg
Posted on: 03/14/2019

Seeking Experienced Solid Waste Engineer
Description: Develop defined scopes of work, prepare RFPs, evaluate and select consultants, and review work product. Projects
Company: Confidential
Location: Tampa
Posted on: 03/16/2019

SQA Engineer
Description: Location: US-FL-TampaJob ID: 2018-1804 of Openings: 1Category: Technology Development and EngineeringPosition Sumary br br Review project documentation requirements/user stories, designs to create, (more...)
Company: Airlines Reporting Corporation
Location: Tampa
Posted on: 03/19/2019

Senior Network Engineer
Description: We invite you to join us in our endeavor to develop a system wide standard and infrastructure to achieve our strategic priority - Exceptional Patient Experience.The
Company: Lee Health
Location: Fort Myers
Posted on: 03/16/2019

Log In or Create An Account

Get the latest Florida jobs by following @recnetFL on Twitter!

Bradenton RSS job feeds