Description

Innometeo is a system for the generation and visualization of weather related data. It is targeted at meteorologists and other technical staff of the portuguese weather (IPMA) and civil protection (ANEPC) national authorities.

While working at Likeno, I was part of the team that developed Innometeo. The system gathers a set of meteorological data products from multiple sources, processes this data into a common format and makes the data products available as a set of collections.

My role

My role on the project was the design and implementation of the backend components, which consist of:

• A set of processing lines that deal with multiple input raster data and its tranformation into output multidimensional netcdf files for various collections of meteorological products. Processing lines were implemented with airflow and the system is distributed over several worker nodes by leveraging rabbitmq as a message broker

• A geospatial server that is able to serve all generated products according to OGC WMS standard. This is implemented with geospaca (more on that below), which is based on MapServer and adds an API layer on top of it.

• A service that provides historical information on each collection for sampled points by inspecting data on-the-fly.

Description

While working at GeoSolutions I was part of the team that developed the Traffic Density Mapping Service (TDMS) for the European Maritime Safety Agency (EMSA). This service generated traffic density maps for the european seas in a fully automated and periodic schedule.

My role

My role on this project was the design and implementation of the processing and visualization components, which consisted of

• A set of automated processing lines implemented with apache airflow and running on a distributed cluster of worker nodes.

• A set of algorithms to

  • Extract ship instantaneous positions from EMSA's oracle database
  • Generate routes for each ship and aggregate routes according to predefined categories
  • Calculate traffic density according to EMSA-supplied methodology
  • Perform temporal aggregation of results
  • Publish results to GeoServer

• Distributing of the final products via WMS using GeoServer, by using its REST API.

Description

The SaveMyBike system constitutes a set of interacting services provided to citizens to improve the usage of bicycle transport and of the other connected sustainable transport modes.

While working at GeoSolutions I was part of the team that developed the SaveMyBike portal, REST API and the backend processing services.

The portal is a standard django project that allows both endusers and admins to act upon their respective bike-related items.

Backend services are responsible for post-processing collected waypoint data uploaded by user's mobile app. These include:

• Cleaning up uploaded waypoint data
• Generating proper linestring tracks from individual waypoints
• Calculation of several indicators related to greenhouse gas emissions and health
• Updating competition scores and leaderboards

These backend services are implemented as a set of Python modules and run on the AWS platform.

My role

In this project I was the main backend engineer, which means I implemented most of the backend code. This included:

• The portal's backend logic, including business rules, data modelling and django-related stuff

• REST API's endpoints

• Integration with keycloak in order to leverage authentication with OpenID Connect

• Orchestrating AWS services and ensuring timely feedback supplied to mobile apps

• Business logic for processing uploaded waypoint data. This includes:

  • Spatial processing of points into segments and tracks
  • Calculation of various environment and health performance indicators
  • Processing competition data.

Description

I worked at IPMA, the portuguese weather authority, on its remote sensing team in the Copernicus Global Land project and its percursor projects (Geoland-2, GMES).

The Copernicus Global Land Service is a component of Copernicus, the European flagship programme on Earth Observation.

IPMA's role in this project was:

• To generate radiation products from geostationary satellites in order to obtain global coverage

• Make these products available to end users by providing the necessary interfaces in order for them to appear at centralized product navigation portals, together with other remote sensing products

My role

My contribution to project was:

• Designed and implemented processing lines for product generation and distribution - these were implemented with Python and ECMWF's ecFlow scheduler.

  The system operated continouously, in near realtime, and most products were generated with an hourly frequency.

• Setup metadata catalog for generated products according to OGC CSW standard. This was implemented with pycsw and it eventually led to my involvment with the pycsw project.

  The metadata schema itself was based on the ISO 19115 standard and compliant with the INSPIRE directive guidelines.

• Designed and implemented a product ordering service compliant with OGC OSEO standard - This was implemented as a reusable django application and was the first (probably still the only one today) open source implementation of this (rather obscure) OGC standard

• Designed and implemented a quality monitoring service that extracted multiple statistical indicators for each generated product and made them available via a REST API