Epicareer Might not Working Properly
Learn More

Data Lake Support Associate

Salary undisclosed

Checking job availability...

Original
Simplified

Job Responsibilities

You will partner with colleagues to provide support functions on the CRB Data Lake:

  • Configure Deployment pipelines relate to code releases from various technical teams in CRB
  • Setup monitoring schedules for pipelines deployed based on geographic areas of consumer usage
  • Troubleshoot failed pipelines within the processes or guidelines, and suggesting solutions to resolve for future
  • Review Synapse notebooks when errors occur and provide details on issues to development teams
  • Review Synapse notebooks when errors occur and fix through development DevOps process
  • Provide onboarding assistance and configuration for new ingestion data sources in conjunction with established processes and guidelines, and suggest improvements
  • Provide DevOps support for deployments to core data lake repositories and monitoring

Qualifications

  • Advanced understanding Azure Synapse, Azure Key Vault, Azure Data Lake Storage v2, and Azure DevOps
  • Experience with Python and creating/edit pySpark notebooks
  • Experience in designing, implementing and evolving data solutions within the Azure Cloud tools
  • Experience in working with large data sets and co-mingling the data for business/system consumption as it relates to the Azure Cloud Modern Data Warehouse or similar data structures
  • Experience with Azure SQL DB, Azure Synapse Analytics, or similar tools sets (e.g. AWS)
  • Experience with data presentation to the user using reporting tools like Power BI for various data quality, presentations, and confidence reviews
  • Knowledge of Data Modeling and Management techniques, as it relates to retrieving data from systems to present for consumption.
  • Dev-ops experience using GIT, developing, deploying code to production

Work Set-up

  • Project-base (6-months) high-possibility of extension or absorption
  • Hybrid set-up (once a week onsite)
  • Mid-Shift (1pm-10pm)
  • Location: BGC, Taguig
  • 100,000 maximum salary package

Job Responsibilities

You will partner with colleagues to provide support functions on the CRB Data Lake:

  • Configure Deployment pipelines relate to code releases from various technical teams in CRB
  • Setup monitoring schedules for pipelines deployed based on geographic areas of consumer usage
  • Troubleshoot failed pipelines within the processes or guidelines, and suggesting solutions to resolve for future
  • Review Synapse notebooks when errors occur and provide details on issues to development teams
  • Review Synapse notebooks when errors occur and fix through development DevOps process
  • Provide onboarding assistance and configuration for new ingestion data sources in conjunction with established processes and guidelines, and suggest improvements
  • Provide DevOps support for deployments to core data lake repositories and monitoring

Qualifications

  • Advanced understanding Azure Synapse, Azure Key Vault, Azure Data Lake Storage v2, and Azure DevOps
  • Experience with Python and creating/edit pySpark notebooks
  • Experience in designing, implementing and evolving data solutions within the Azure Cloud tools
  • Experience in working with large data sets and co-mingling the data for business/system consumption as it relates to the Azure Cloud Modern Data Warehouse or similar data structures
  • Experience with Azure SQL DB, Azure Synapse Analytics, or similar tools sets (e.g. AWS)
  • Experience with data presentation to the user using reporting tools like Power BI for various data quality, presentations, and confidence reviews
  • Knowledge of Data Modeling and Management techniques, as it relates to retrieving data from systems to present for consumption.
  • Dev-ops experience using GIT, developing, deploying code to production

Work Set-up

  • Project-base (6-months) high-possibility of extension or absorption
  • Hybrid set-up (once a week onsite)
  • Mid-Shift (1pm-10pm)
  • Location: BGC, Taguig
  • 100,000 maximum salary package