BradentonRecruiter
the smart solution for Bradenton jobs

Data Engineer - Hadoop/Spark

Company: Future Focus Infotech pvt ltd
Location: Bradenton
Posted on: November 10, 2018

Job Description:

Job Title: Data Engineer - Hadoop/Spark Location: Boynton Beach,FL & Bradenton, FL Duration: 6 months JD: BigData and Hadoop Ecosystems, Microsoft Azure, Python, Apache & Spark, Kafka, Scala Essential Skills: The Data Engineer will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources. The Data engineer will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports. The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with. Skill Need so Expertise working with large scale distributed systems (Hadoop, Spark Strong understanding of the big data cluster, and its architectureo Experience building and optimizing big data ETL pipelines.o Advanced programming skills with Python, Java, Scala Good knowledge of spark internals and performance tuning of spark jobs. Strong SQL skills and is comfortable operating with relational data models and structure. Capable of accessing data via a variety of API/RESTful services. Experience with messaging systems like Kafka. Experience with No SQL databases. Neo4j, mongo, etc. Expertise with Continuous Integration/Continuous Delivery workflows and supporting applications. Exposure to cloud environments and architectures. (preferably Azure)o Ability to work collaboratively with other teams. Experience with containerization using tools such as Docker. Strong knowledge of Linux and Bash. Can interact with the OS at the command line and create shell scripts to automate workflows. Advanced understanding of software development and collaboration, including experience with tools such as Git. Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. Essential Responsibilities include but not limited to Design and develop ETL workflows to migrate data from varied data sources including SQL Server, Netezza, Kafka etc. in batch and real-time. Develop checks and balances to ensure integrity of the ingested data. Design and Develop Spark jobs as per requirements for data processing needs. Work with Analysts and Data Scientists to assist them in building scalable data products. Designs systems, alerts, and dashboards to monitor data products in production

Keywords: Future Focus Infotech pvt ltd, Bradenton , Data Engineer - Hadoop/Spark, Engineering , Bradenton, Florida

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Network Admin/Engineer
Description: System One has an immediate opening in St. Pete, FL for a Network Admin/Engineer with a large Engineering client. This is a 12 month contract with the potential for extension or full-time conversion. (more...)
Company: System One
Location: Saint Petersburg
Posted on: 11/15/2018

Electrical Engineer
Description: Responsibilities Electrical design for a diverse range of commercial buildings hotels, hospitals, airports, higher education, K-12, stadiums, performing
Company: TLC Engineering for Architecture
Location: Tampa
Posted on: 11/15/2018

Cable Television Maintenance Technician
Description: Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative (more...)
Company: Comcast
Location: Lehigh Acres
Posted on: 11/15/2018


Broadband Technician
Description: Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative (more...)
Company: Comcast
Location: Lehigh Acres
Posted on: 11/15/2018

Water Resources Engineer
Description: Water Resources Engineer in St. Petersburg, FL Responsible for stormwater management,
Company: Land & Water Engineering Science, Inc.
Location: Saint Petersburg
Posted on: 11/15/2018

Cabling Technician
Description: Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative (more...)
Company: Comcast
Location: Fort Myers
Posted on: 11/15/2018

Principal Algorithm Development Engineer
Description: Acara Solutions is looking for Principal Algorithm Development Engineer for our client located St Petersburg, FL -Client Security Detection Systems is seeking for a Principal Algorithm Development Engineer (more...)
Company: Acara Solutions
Location: Saint Petersburg
Posted on: 11/15/2018

Cable Maintenance Technician
Description: Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative (more...)
Company: Comcast
Location: Bonita Springs
Posted on: 11/15/2018

Diesel Mechanic
Description: We are looking for a high energy Diesel Mechanic to join the team. br br br br DUTIES AND RESPONSIBILITIES: br br Perform repairs and assigned preventative maintenance services. Performs inspections, (more...)
Company: Waste Connections US, Inc
Location: Fort Myers
Posted on: 11/15/2018

Electrical Engineer - Water Facilities Design
Description: An Electrical Engineer with a PE license and experience in the water/wastewater industry is needed to help design state-of-the-art facilities that treat, preserve and conserve the earth---s finite water (more...)
Company: Cameron Craig Group
Location: Clearwater
Posted on: 11/15/2018

Log In or Create An Account

Get the latest Florida jobs by following @recnetFL on Twitter!

Bradenton RSS job feeds