HD Supply Senior Data Engineer in Jacksonville, Florida
Skills needed for this position:
10+ years experience as a senior data engineer with progressive responsibilities and recent experience in Google Cloud Platform offerings
Proven track record designing/implementing highly available and scalable ETL/ELT pipelines in the Cloud using tools like Apache Beam, Airflow, Kafka, SSIS, Azure Data Factory.
Extensive knowledge of data engineering and modeling principals (Structured/Unstructured Data, Normalization, Ingestion Patterns)
Cloud experience, GCP preferred
Innate ability to lead and collaborate as a fully remote team member
Excellent written and oral communication skills are a must for this role
Desire to understand business needs and put customers first
Passionate about technology with high technical aptitude and desire to learn new things
What you'll be doing in this role:
Designing, testing, and implementing complex self-recovering ELT/ETL pipeline processes.
API development for data applications (REST).
DevOps for source control and automatio including use of containers (Docker, Kubernetes) and CI/CD tools like Jenkins, Terraform.
Working with Google Cloud Platform (Cloud Composer, Cloud Storage, Dataflow, Pub/Sub, Cloud Functions, GKE Clusters, Shared VPCs, Cloud SQL, Big Query, Compute Engine, IAM Roles).
Building strong relationships and streams of collaboration across teams.
Providing support when needed including new solution deployment and troubleshooting issues with existing solutions as problems arise.
Will take on challenging technical projects defining solutions and implementing them yourself as well as in partnership with other engineers.
Open to non-local candidates working 100% remote.
Design, develop (code), test, and debug applications. Provide experienced Ready-to-Serve and development subject matter expertise. Maintain, enhance and provide solutions for software applications. Provide development leadership in a functional area, module, or project.
Major Tasks, Responsibilities, and Key Accountabilities
Works with stakeholders to perform application functionality gap analysis and feasibility studies.
Leads development activities for a functional area, module, or project. Provides and documents technical design and specifications meeting business and functional requirements.
Develops (code), implements and maintains tools/applications. Ensures applications and systems possess sufficient controls.
Performs unit testing prior to moving code/configuration to the QA process. Evaluates and researches upgrades, patches and new functionality. Researches defects and solve for root cause in applications.
Assists in the development and definition of test plans and scripts for performance, regression and user acceptance test plans; support QA activities as required.
Builds and maintains templates, rules, style sheets, workflows, data extractions and imports, interfaces, and object models.
Analyzes applications for compliance with security protocols.
Trains team members on areas of expertise. Participate in and lead peer reviews.
Nature and Scope
Identifies key barriers/core problems and applies problem solving skills in order to deal creatively with complex situations. Troubleshoots and resolves complex problems. Makes decisions under conditions of uncertainty, sometimes with incomplete information, that produce effective end results.
Independently performs assignments with instruction limited to the expected results. Determines and develops an approach to solutions. Receives technical guidance only on unusual or complex problems or issues.
May oversee the completion of projects and assignments, including planning, assigning, monitoring and reviewing progress and accuracy of work, evaluating results, etc. Contributes to employees' professional development but does not have hiring or firing authority.
Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.
Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.
Typically requires overnight travel less than 10% of the time.
Education and Experience
- Typically requires BS/BA in a related discipline. Generally 5-8 years of experience in a related field OR MS/MA and generally 3-5 years of experience in a related field. Certification is required in some areas.
HD Supply is an Equal Opportunity Minority/Female/Individuals with Disabilities/Protected Veteran and Affirmative Action Employer. HD Supply considers for employment and hires qualified candidates without regard to age, race, religion, color, sex, sexual orientation, gender, gender identity, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law.