Discussion:
Upper limit for a dump file?
(too old to reply)
Kris Kiger
2004-06-08 21:34:24 UTC
Permalink
I am trying to restore a dump of two independant databases. Each
database is the same in table structure (there is only one table that
consists of 5 integers, a timestamp with time zone, and a boolean).
Here are the number of rows:
DB1 - 115,539,855 rows
DB2 - 118,022,948 rows

There are no keys/indexes/etc on the table. The uncompressed tar file
is 5.5GB. I am running PG 7.4.

When I try to move this data to another database (via pg_dump &
pg_restore) it fails each time, for each database) with:
pg_restore: [archiver (db)] error returned by PQputline

I find it highly unlikely that I have corrupted data in each database,
since each were generated on different postgres installations on
different machines. I can still query the original databases (DB1 &
DB2) with no problem. It looks like all of the data is intact. Any
ideas what may be the root of the problem or how I can find out more
about this error PQputline returned?

In advance, I appreciate your help!

Kris



---------------------------(end of broadcast)---------------------------
TIP 7: don't forget to increase your free space map settings
Sam Barnett-Cormack
2004-06-09 01:42:07 UTC
Permalink
Post by Kris Kiger
I am trying to restore a dump of two independant databases. Each
database is the same in table structure (there is only one table that
consists of 5 integers, a timestamp with time zone, and a boolean).
DB1 - 115,539,855 rows
DB2 - 118,022,948 rows
There are no keys/indexes/etc on the table. The uncompressed tar file
is 5.5GB. I am running PG 7.4.
When I try to move this data to another database (via pg_dump &
pg_restore: [archiver (db)] error returned by PQputline
I find it highly unlikely that I have corrupted data in each database,
since each were generated on different postgres installations on
different machines. I can still query the original databases (DB1 &
DB2) with no problem. It looks like all of the data is intact. Any
ideas what may be the root of the problem or how I can find out more
about this error PQputline returned?
Perhaps the other machine has a filesystem limit forbidding such large
files? Various filesystems have historically been limited to 2GB
--
Sam Barnett-Cormack
Software Developer | Student of Physics & Maths
UK Mirror Service (http://www.mirror.ac.uk) | Lancaster University

---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
joining column's datatypes do not match
Loading...