Community Portal

Process dataset

Created on Wednesday 21 April 2021, 13:48

Back to task list
  • ID
  • Project
    Metabolism of Cities Data Hub
  • Status
    In Progress
  • Priority
  • Type
    Process a dataset
  • Related to
  • Assigned to
    Aristide Athanassiadis
  • Subscribers
    Aristide Athanassiadis
    Paul Hoekman

You are not logged in

Log In Register

Please join us and let's build things, together!

Discussion and updates

This task was created by the system

Processing work was started

Hey Paul,
I finally finished formating the population data (oof that was brutal). I've tried to upload a new file when processing but every time I'm redirected to the "Metabolism of Cities is updating page". Here is the file attached.
Let me know if I'm doing something wrong.

Heu Paul, I'm just putting another message about this topic so it does not fall off from your radar :)

Thanks Aris, this slipped through the cracks, hadn't noticed it before! (we need a global notification system for relevant stuff, somehow). Anyway the problem is that with dataset is too large and it can not be processed in a single user session (which is up to 30 seconds or something). Just like we did with shapefiles, we need to process this by putting it in a queue and running a script server-side to do it afterwards. I made a task here. Please subscribe to the task and when I have completed this, try again. Thanks!

BTW 16k records... all countries in the world... epic stuff Aris, I can imagine prepping this was brutal --- thanks for persevering though and it will be exciting to get this in!!

Ok great Paul! Thanks for making the task, I just subsribed!

And you're right, prepping this was quite painful but we won't need to change it for a while! Btw, there were some inconsistancies with the countries used by UN and ours. But normally it's all well formatted.

Noted Aris. We will see when we import the dataset how it goes!