BradentonRecruiter Since 2001
the smart solution for Bradenton jobs

Data Engineer - Hadoop/Spark

Company: Future Focus Infotech pvt ltd
Location: Bradenton
Posted on: July 8, 2019

Job Description:

Job Title: Data Engineer - Hadoop/Spark Location: Boynton Beach,FL & Bradenton, FL Duration: 6 months JD: BigData and Hadoop Ecosystems, Microsoft Azure, Python, Apache & Spark, Kafka, Scala Essential Skills: The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources. The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports. The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with. Skill Need so Expertise working with large scale distributed systems (Hadoop, Spark Strong understanding of the big data cluster, and its architectureo Experience building and optimizing big data ETL pipelines.o Advanced programming skills with Python, Java, Scala Good knowledge of spark internals and performance tuning of spark jobs. Strong SQL skills and is comfortable operating with relational data models and structure. Capable of accessing data via a variety of API/RESTful services. Experience with messaging systems like Kafka. Experience with No SQL databases. Neo4j, mongo, etc. Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications. Exposure to cloud environments and architectures. (preferably Azure)o Ability to work collaboratively with other teams. Experience with containerization using tools such as Docker. Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows. Advanced understanding of software development and collaboration, including experience with tools such as Git. Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. Essential Responsibilities include but not limited to Design and develop ETL workflows to migrate data from varied data sources including SQL Server, Netezza, Kafka etc. in batch and real-time. Develop checks and balances to ensure integrity of the ingested data. Design and Develop Spark jobs as per requirements for data processing needs. Work with Analysts and Data Scientists to assist them in building scalable data products. Designs systems, alerts, and dashboards to monitor data products in production

Keywords: Future Focus Infotech pvt ltd, Bradenton , Data Engineer - Hadoop/Spark, IT / Software / Systems , Bradenton, Florida

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


Junior C++ Developer - Tampa
Description: Revature is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers.Our Software Engineers design, analyze and build next-gen (more...)
Company: Revature
Location: Tampa
Posted on: 07/19/2019

Entry Level .Net Software Developer
Description: Revature is the fastest growing employer of emerging technology talent in the US and we are currently looking to hire over 100 new Software Engineers.Our Software Engineers design, analyze and build next-gen (more...)
Company: Revature
Location: Clearwater
Posted on: 07/19/2019

Senior Application Developer - Tampa
Description: SunIRef:it Senior Application Developer - Tampa CoAdvantage 33 reviews - Tampa, FL 33618 CoAdvantage 33 reviews Read what people are saying about working here. CoAd Summary: CoAdvantage, a portfolio company (more...)
Company: CoAdvantage
Location: Tampa
Posted on: 07/19/2019


Sr Associate Software Engineer - Salesforce
Description: Amgen NASDAQ:AMGN , a biotechnology pioneer, discovers, develops and delivers innovative human therapeutics. Our medicines have helped millions of patients in the struggle against cancer, kidney disease, (more...)
Company: Amgen
Location: Tampa
Posted on: 07/19/2019

Microsoft D365/AX Finance Functional Consultant (Remote)
Description: As a Sopris D365 Consultant, you will be responsible for participating in all phases of the project life cycle to achieve a successful project delivery. You will be expected to maintain the highest standards (more...)
Company: Sopris Systems
Location: Lakeland
Posted on: 07/19/2019

Senior Associate IS Software Engineer
Description: Amgen is seeking a talented Software Engineer to work with modern technology stacks that will be used by our business functions to drive Amgen's innovation across Operations. The candidate will join our (more...)
Company: Amgen
Location: Tampa
Posted on: 07/19/2019

Business Intelligence Developer
Description: Dogwood Management Partners is seeking a Business Intelligence Developer for an opening we have in Tampa, FL. This is for a full-time opportunity, offering a competitive salary and excellent benefits. (more...)
Company: Dogwood Management Partners, LLc
Location: Tampa
Posted on: 07/19/2019

Sr. Associate Software Engineer
Description: Amgen is seeking a talented Software Engineer to work with modern technology stacks that will be used by our business functions to drive Amgen's innovation across Operations. The candidate will join our (more...)
Company: Amgen
Location: Tampa
Posted on: 07/19/2019

Junior Test Automation Engineer _ Mobile App Testing
Description: . Overall 5 years of experience Strong in Mobile App Testing
Company: TekShapers
Location: Brandon
Posted on: 07/19/2019

Machine Learning Software Engineer
Description: RESPONSIBILITIES:Kforce has a client in building a team of Machine Learning Software Engineers in Wilmington, Delaware DE and Tampa, Florida FL and Plano, Texas TX . This team is focused on developing (more...)
Company: Kforce
Location: Tampa
Posted on: 07/19/2019

Log In or Create An Account

Get the latest Florida jobs by following @recnetFL on Twitter!

Bradenton RSS job feeds