L9 / L10 Level
We are looking for a highly skilled Web Crawler Developer to build scalable data scraping solutions across multiple partner platforms. You will work closely with our data engineering and cloud automation teams to deliver high-quality structured data with multilingual capabilities.
What You’ll Do
- Design and develop robust web crawlers and data scrapers to extract product and points-of-interest information.
- Build and optimize data cleaning and transformation pipelines, ensuring resilience against HTML changes and anti-bot measures.
- Leverage Azure services(Azure Functions, Logic Apps, Data Factory, Storage) to automate, orchestrate, and scale workflows.
- Implement semantic search and vector indexing using Azure Cognitive Search, Pinecone, FAISS, or Weaviate.
- Integrate multilingual translation APIs to deliver multi-language data outputs for global consumption.
- Maintain high standards of JSON structuring, REST API integration, and Git-based version control.
- Strong proficiency in Python with hands-on tools like BeautifulSoup, Requests, and Selenium.
- Proven experience deploying production-grade web scraping solutions in cloud environments.
- Solid understanding of data pipelines and backend integration best practices.
Please note: Due to the anticipated high volume of applications, only shortlisted candidates will be contacted. All information provided will be treated with strict confidentiality and used solely for recruitment purposes.
Lee Zhi Yang, Evan
Consultant – IT & Digital
EA Personnel No: R25157593
Peoplebank Singapore Pte Ltd | EA Licence No: 08C5248