Data Engineer
Posted 8 months ago
Job Description:
- Build and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing/quality solutions.
- Design data solutions.
- Analyze sources to determine value and recommend data to include in analytical processes.
- Incorporate core data management competencies including data governance, data security and data quality.
- Collaborate within and across teams to support delivery and educate end users on data products/analytic environment.
- Perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate.
- Understanding of cloud architectures and enabling tools and technologies, such as, AWS Cloud (GovCloud/C2S).
- Familiar with Amazon Web Managed Services (AWS).
- Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS, Kafka, AWS Lambda, NiFi, Airflow, or similar.
- Proficient experience utilizing JavaScript, Elasticsearch, JSON, SQL, XML.
- Working knowledge with datastores MongoDB/DynamoDB, PostgreSQL, S3, Redshift, JDBC/ODBC, and Redis.
- Test data movement, transformation code, and data components.
- Perform other duties as assigned.
- Familiar with Linux/Unix server environments.
- Experience with Agile development methodology.
- Publishing and/or presenting design reports.
- Coordinating with other team members to reach project milestones and deadlines.
- Test data movement, transformation code, and data components.
- Working knowledge with Collaboration tools, such as, Jira and Confluence.