Data Engineer (Web scraping specialist)

Company:
Location: Amsterdam

*** Mention DataYoshi when applying ***

Matrixian Group offers location driven data solutions through our Address Intelligence, Real Estate Intelligence, Urban Intelligence and our Drimble offerings. Matrixian Group is looking to add a data collection engineer to our development team.

We have a constant need to maintain and monitor a large number of existing sources and update and extend our data lake with new and high quality data sources, both local and international for use in our data models

Full-time · Amsterdam

About the job role

As our data collection engineer you will be responsible for:
  • Maintaining and monitoring existing data sources
  • Finding new data sources
  • Assessing new data sources for potential fit with Matrixian's data requirement
  • Developing web-crawling, scraping data mining tooling and scheduling to retrieve data on ad-hoc and/or recurring basis
  • Cleaning up and structuring incoming data for ingesting in our data lake
  • Developing and maintaining the monitoring and notification system
  • Providing documentation and testing scripts.
This position reports to the development Team Lead and you will work closely together with our data engineers, and systems admin colleagues.

About you

  • You have a relevant Bachelor's degree in IT or related field or equivalent through experience
  • You have 1-2 years experience in creating and managing web scrapers and data aggregation tools
  • You have a thorough understanding of MySQL databases
  • You have expertise or extensive experience with Python and at least understanding of PHP
  • You have knowledge and/or experience in BeatifulSoup and Selenium
  • You like working in a team and taking responsibility.
  • You are at your best in a dynamic environment, where every day brings new challenges.
  • You are fluent in the Dutch and English language
  • Having knowledge of Bash and cURL is a plus


What we offer

  • Salary € 2,500 - € 3,000
  • Holiday allowance
  • 25 holidays
  • L&D budget
  • Lots of responsibility, independence and room for initiatives and possibilities to make your mark and to develop
  • Open and non hierarchical culture
  • Team of teamplayers

*** Mention DataYoshi when applying ***

Offers you may like...

  • Experfy Inc

    Big Data Engineer
    Remote
  • EXOS

    Sr. Data Engineer
    Remote
  • Amgen

    Sr Data Engineer - (Remote U.S.)
    Los Angeles, CA
  • Mayo Clinic

    Senior Data Engineer
    Phoenix, AZ 85001
  • Loram

    Customer Support Data Engineer - LTI, Georgetown, ...
    Georgetown, TX 78626