Skip to content

Question: could not extend file "base/361191441/368615606.137": No space left on device #2092

@Klaus-Tockloth

Description

@Klaus-Tockloth

On an HDD-based Ubuntu system, I fully imported the planet file monthly. However, the last import failed due to lack of disk space.

2023-10-15 20:58:04  ERROR: Database error: ERROR:  could not extend file "base/361191441/368615606.137": No space left on device

Questions:

  • Who creates the file (PostgreSQL or osm2pgsql)?
  • Where is the file located/created?
  • What could I do about the problem?

Additional question:

  • Is it possible to run only the "post processing" step?

Import command:

nohup ./osm2pgsql-1.9.2 --username postgres --multi-geometry --hstore --slim --drop --flat-nodes nodes.bin --create --cache 24000 --number-processes 10 --database osmplanet --style openstreetmap-carto.style --tag-transform-script openstreetmap-carto.lua --input-reader=pbf planet-latest.osm.pbf >load_osmplanet.out 2>&1 &

osm2pgsql output:

$ cat load_osmplanet.out
nohup: ignoring input
2023-10-13 08:46:07  osm2pgsql version 1.9.2 (1.9.2)
2023-10-13 08:46:07  Database version: 12.16 (Ubuntu 12.16-0ubuntu0.20.04.1)
2023-10-13 08:46:07  PostGIS version: 3.0
2023-10-13 08:46:07  Storing properties to table '"public"."osm2pgsql_properties"'.
2023-10-13 08:46:07  Setting up table 'planet_osm_point'
2023-10-13 08:46:07  Setting up table 'planet_osm_line'
2023-10-13 08:46:08  Setting up table 'planet_osm_polygon'
2023-10-13 08:46:08  Setting up table 'planet_osm_roads'
2023-10-15 15:43:05  Reading input files done in 197817s (54h 56m 57s).                   
2023-10-15 15:43:05    Processed 8658483163 nodes in 3760s (1h 2m 40s) - 2303k/s
2023-10-15 15:43:05    Processed 971692934 ways in 30307s (8h 25m 7s) - 32k/s
2023-10-15 15:43:05    Processed 11340554 relations in 163750s (45h 29m 10s) - 69/s
2023-10-15 15:43:40  Dropping table 'planet_osm_nodes'
2023-10-15 15:43:41  Table 'planet_osm_nodes' dropped in 0s
2023-10-15 15:43:41  Dropping table 'planet_osm_ways'
2023-10-15 15:44:48  Table 'planet_osm_ways' dropped in 67s (1m 7s)
2023-10-15 15:44:48  Dropping table 'planet_osm_rels'
2023-10-15 15:44:50  Table 'planet_osm_rels' dropped in 2s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_nodes' in 0s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_ways' in 0s
2023-10-15 15:44:50  Done postprocessing on table 'planet_osm_rels' in 0s
2023-10-15 15:44:51  Clustering table 'planet_osm_roads' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_polygon' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_line' by geometry...
2023-10-15 15:44:51  Clustering table 'planet_osm_point' by geometry...
2023-10-15 16:16:22  Creating geometry index on table 'planet_osm_roads'...
2023-10-15 16:34:10  Analyzing table 'planet_osm_roads'...
2023-10-15 16:34:14  Creating geometry index on table 'planet_osm_point'...
2023-10-15 18:01:46  Analyzing table 'planet_osm_point'...
2023-10-15 18:09:03  All postprocessing on table 'planet_osm_point' done in 8653s (2h 24m 13s).
2023-10-15 20:58:04  All postprocessing on table 'planet_osm_roads' done in 3004s (50m 4s).
2023-10-15 20:58:04  ERROR: Database error: ERROR:  could not extend file "base/361191441/368615606.137": No space left on device
HINT:  Check free disk space.

HDD space:

$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev             63G     0   63G   0% /dev
tmpfs            13G  1.2M   13G   1% /run
/dev/md2        2.0T  1.4T  471G  76% /                    <- database
tmpfs            63G   16K   63G   1% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            63G     0   63G   0% /sys/fs/cgroup
/dev/loop1       41M   41M     0 100% /snap/snapd/20092
/dev/loop0       62M   62M     0 100% /snap/zig/8241
/dev/loop3      128K  128K     0 100% /snap/bare/5
/dev/loop2       41M   41M     0 100% /snap/snapd/20290
/dev/md3        5.3T  727G  4.3T  15% /home                <- osm2pgsql
/dev/md1        485M  161M  299M  35% /boot
tmpfs            13G     0   13G   0% /run/user/1000
tmpfs            13G     0   13G   0% /run/user/1004

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions