Data Engineer (W2) Job at Systemart, LLC, Trenton, NJ

N25yV2dnTmVpNnZ0eGhXOVQ2ckg3QjRzMVE9PQ==
  • Systemart, LLC
  • Trenton, NJ

Job Description

Job Description

Design, implement, and optimize data solutions using the Snowflake cloud data platform. This role plays a pivotal part in architecting data warehouses, data lakes, and ETL processes to enable efficient data storage, processing, and analytics for the DOE.

A Senior Snowflake Developer is a highly skilled professional responsible for designing, implementing, and optimizing data solutions using the Snowflake cloud data platform. This role plays a pivotal part in architecting data warehouses, data lakes, and ETL processes to enable efficient data storage, processing, and analytics for the organization.

Responsibilities

1. Data Architecture

- Collaborate with data architects to design and develop Snowflake data models and schemas.

- Create and maintain a well-structured data warehouse and data lake architecture.

2. Data Integration

- Develop ETL (Extract, Transform, Load) processes to ingest data from various sources into Snowflake.

- Ensure data integration processes are efficient, reliable, and scalable.

- Design and implement data pipelines using Snowflake features like tasks and streams.

3. Performance Optimization

- Optimize query performance by creating and maintaining appropriate indexes, materialized views, and clustering keys.

- Identify and resolve performance bottlenecks in data processing.

4. SQL Development

- Write complex SQL queries, stored procedures, and user-defined functions (UDFs) to support data analytics and reporting needs.

- Ensure SQL code follows best practices for readability and performance.

5. Security and Access Control

- Implement and manage security measures, including role-based access control (RBAC) and data encryption, to protect sensitive data.

- Audit and monitor data access and user activities.

6. Data Quality Assurance

- Define and implement data quality checks and validation processes to maintain data accuracy.

- Establish data quality rules and alerts to proactively identify issues.

7. Documentation

- Create and maintain technical documentation for data models, ETL processes, and data dictionaries.

- Document best practices, standards, and guidelines for Snowflake development.

8. Version Control and Deployment

- Use version control systems (e.g., Git) for managing Snowflake SQL scripts and objects.

- Coordinate the deployment of changes to Snowflake environments.

9. Monitoring and Alerts

- Set up monitoring and alerting for Snowflake environments to proactively detect and respond to issues.

- Troubleshoot and resolve incidents related to data processing and performance.

10. Backup and Recovery

- Implement backup and recovery strategies to ensure data integrity and availability.

- Develop and test data recovery procedures.

11. Collaboration

- Collaborate with data engineers, data scientists, and business analysts to understand data requirements and provide data solutions.

- Work with cross-functional teams to support data-related projects and initiatives.

Qualifications

  • Bachelor's or master's degree in computer science, data engineering, or a related field.
  • 7+ years of experience as a Snowflake developer or data engineer with a focus on data warehousing and ETL.
  • Snowflake certification(s) is a plus.
  • Strong SQL skills and proficiency in data modeling and database design.
  • Knowledge of cloud data warehousing concepts and best practices.
  • Familiarity with data integration tools and technologies.
  • Solid understanding of data governance, data security, and compliance requirements.
  • Experience with version control systems and deployment processes.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication and collaboration abilities.
  • Ability to work in an Agile or iterative development environment.

Job Tags

Similar Jobs

Legacy Health

Revenue & Referral Intake Specialist Job at Legacy Health

 ...department referral process. Provides data entry and clerical support for the referral process for both pre-paid and fee-for-service health plans. Understands each health plans guidelines, benefits and basic risk models. Understands and follows departments... 

Trinity Health

Nursing Manager (Neuro Surgical Trauma) Job at Trinity Health

 ...way in critical care throughout the Treasure Valley, and our Neuro Surgical Trauma Unit is an example of the high standard of care we provide. Were looking for a Neuro Surgical Trauma Nurse Manager to oversee this specialized, high-acuity unit, ensuring it... 

VistAbility

In-Home Caregiver Job at VistAbility

Position: Caregiver for Adults with Disabilities Location: Fremont / Union City Hours: Part-Time Monday - Friday; 9:00am - 1:00pm (20 hrs/wk) Compensation: $20.50 per hour Make a Difference as a Caregiver for Adults with Disabilities! Are you passionate...

Ladder

Apprentice Electrician with Hammett Electric Company Job at Ladder

 ...apprentice electricians for utility construction projects. No experience required. Candidate Requirements: Willing to Work from...  ...Insurance Paid Holidays Weekly Pay (As Opposed To Bi-Weekly) Apprenticeship Training Tuition Reimbursement Apply On Ladder:... 

KellyMitchell Group

Risk and Security Analyst Job at KellyMitchell Group

 ...Job Summary: Our client is seeking a Risk and Security Analyst to join their team! This position is located in Wayzata, Minnesota. Duties: Oversee the onboarding and integration of security tooling, including Checkmarx, SysDig, WiZ, and GitGuardian Manage...