Clustering Postgres

[Kris Kiger]

Has anyone heard of clusgres or, better yet, had any experience with it?
I came across it while searching for active clustering projects.

http://www.linuxlabs.com/clusgres.html

Thanks in advance for the info!

Kris


---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?

http://archives.postgresql.org

[Greg Spiegelberg]

2 dual PIII-1.4GHz Linux RedHat 3.0 servers each with onboard AIC7xxx
and 2 U160 drives (mirrored), 2 GB of ECC memory, 2 onboard Intel Ether
Pro 100Mbps type NIC's, 1 Qlogic 2310 HBA on a 1GBs SAN using a Candera
510 storage cluster with Xyratex SATA on the backend configured with 1+0
LUN's. It will be using a private network and a small disk on the SAN
as the interconnect.

Once I have it running and I've run the necessary tests for myself
I could run a few tests for anyone else who is interested. Deadline
is June 18th when either I scrap it and try a different solution or
we have to buy in which case I'll need it for our production databases.
Below is the config I intend to use for PostgreSQL 7.4.2.

Greg


PostgreSQL 7.4.2 config & compile
configure \
--prefix=/psfs1/apps/pgsql-7.4.2 \
--enable-thread-safety \
--enable-largefiles \
--enable-odbc \
--enable-multibyte \
--enable-shared \
--enable-syslog \
--with-perl \
--with-CXX \
--with-pam \
--with-maxbackends=128 \
--with-tcl \
--with-readline \
--with-zlib
make -j 2 CPPFLAGS="-O3 -DALLOW_ABSOLUTE_DBPATHS -DLOCK_DEBUG" all

Do you mean that you are actually testing this product now? If so,
what's the hardware configuration (nodes, storage server, interconnects)
that you are using?
Warmest regards, Ericson Smith
Tracking Specialist/DBA
+-----------------------+-----------------------------------------+
| http://www.did-it.com | "3 Years ago I was worth $5M on paper!" |
| 516-255-0500 | - Tom Tomorrow |
+-----------------------+-----------------------------------------+

Robert,
I am currently evaluating PolyServe Matrix Server which is a clustering
solution including a clustered file system (mounted read-write
everywhere).
Anything special anyone wants to know? I'm using PostgreSQL 7.4.2 in
a Linux cluster.
Greg

Post by Kris Kiger
Has anyone heard of clusgres or, better yet, had any experience with
it? I came across it while searching for active clustering projects.
http://www.linuxlabs.com/clusgres.html
Thanks in advance for the info!

I have heard of it but I've not heard of any reports on these lists of
how well it works. If you (or anyone else) gives it a spin please try to
post an account to the list and/or if you send me the info it could
probably make its way on to techdocs.
Robert Treat

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

--
Greg Spiegelberg
Product Development Manager
Cranel, Incorporated.
Phone: [phone]
Fax: [phone]
Email: ***@cranel.com
Technology. Integrity. Focus. V-Solve!


---------------------------(end of broadcast)---------------------------
TIP 2: you can get off all lists at once with the unregister command
(send "unregister YourEmailAddressHere" to ***@postgresql.org)

[Ericson Smith]

We'd be very interested in the performance, especially with the disk
being used as in interconnect (I assume that that is being used to
simulate global shared memory?)

We did have a talk with the folks over at http://www.linuxlabs.com/clustgres

They were honest enough to say that even with the Dolphon interconnects, that writing would be slower than usual. We have not made a complete decision on that yet, but are still looking at alternatives.

It seems that Clustres might be a good solution. They use a SAN, the Dolphin interconnects, and multiple diskless nodes. In theory I am sure it works, but this is one of the chicken/egg problems where we want to see it in general use first before committing :-)

- Ericson

Post by Greg Spiegelberg
2 dual PIII-1.4GHz Linux RedHat 3.0 servers each with onboard AIC7xxx
and 2 U160 drives (mirrored), 2 GB of ECC memory, 2 onboard Intel Ether
Pro 100Mbps type NIC's, 1 Qlogic 2310 HBA on a 1GBs SAN using a Candera
510 storage cluster with Xyratex SATA on the backend configured with 1+0
LUN's. It will be using a private network and a small disk on the SAN
as the interconnect.
Once I have it running and I've run the necessary tests for myself
I could run a few tests for anyone else who is interested. Deadline
is June 18th when either I scrap it and try a different solution or
we have to buy in which case I'll need it for our production databases.
Below is the config I intend to use for PostgreSQL 7.4.2.
Greg
PostgreSQL 7.4.2 config & compile
configure \
--prefix=/psfs1/apps/pgsql-7.4.2 \
--enable-thread-safety \
--enable-largefiles \
--enable-odbc \
--enable-multibyte \
--enable-shared \
--enable-syslog \
--with-perl \
--with-CXX \
--with-pam \
--with-maxbackends=128 \
--with-tcl \
--with-readline \
--with-zlib
make -j 2 CPPFLAGS="-O3 -DALLOW_ABSOLUTE_DBPATHS -DLOCK_DEBUG" all

Do you mean that you are actually testing this product now? If so,
what's the hardware configuration (nodes, storage server,
interconnects) that you are using?
Warmest regards, Ericson Smith
Tracking Specialist/DBA
+-----------------------+-----------------------------------------+
| http://www.did-it.com | "3 Years ago I was worth $5M on paper!" |
| 516-255-0500 | - Tom Tomorrow |
+-----------------------+-----------------------------------------+

Robert,
I am currently evaluating PolyServe Matrix Server which is a clustering
solution including a clustered file system (mounted read-write
everywhere).
Anything special anyone wants to know? I'm using PostgreSQL 7.4.2 in
a Linux cluster.
Greg

Post by Kris Kiger
Has anyone heard of clusgres or, better yet, had any experience
with it? I came across it while searching for active clustering
projects.
http://www.linuxlabs.com/clusgres.html
Thanks in advance for the info!

I have heard of it but I've not heard of any reports on these lists of
how well it works. If you (or anyone else) gives it a spin please try to
post an account to the list and/or if you send me the info it could
probably make its way on to techdocs.
Robert Treat

---------------------------(end of broadcast)---------------------------
TIP 4: Don't 'kill -9' the postmaster

[Robert Treat]

Some basics on how easy it is to install/configure and some before/after type
benchmarks showing how it affected performance. Perferrably you could
measure simple vs. complex queries as well as update vs. insert performance.
If you're really ambitious you could try running one of the tpc style
benchmarks on the system, check the archives or the osdl site for more info
on getting these up and running.

Robert Treat

Robert,
I am currently evaluating PolyServe Matrix Server which is a clustering
solution including a clustered file system (mounted read-write
everywhere).
Anything special anyone wants to know? I'm using PostgreSQL 7.4.2 in
a Linux cluster.
Greg

Post by Kris Kiger
Has anyone heard of clusgres or, better yet, had any experience with it?
I came across it while searching for active clustering projects.
http://www.linuxlabs.com/clusgres.html
Thanks in advance for the info!

I have heard of it but I've not heard of any reports on these lists of
how well it works. If you (or anyone else) gives it a spin please try to
post an account to the list and/or if you send me the info it could
probably make its way on to techdocs.
Robert Treat

[Greg Spiegelberg]

Here's the basics basically because I ran out of time and budget to
actually purchase it but here's what I know.

1 day to install. Installed RedHat ES 3.0 from scratch, and the
PolyServe process took perhaps 1.5 hours to install including a
kernel build and system reboot. Roughly 2 hours into PolyServe I
had my first psfs (shared cluster) partition setup on my 1Gb SAN.

Just doing a basic dd to write 1.5GB and 5GB to an ext3 on the
same hardware produced roughly 115 MB/s and 107 MB/s respectively.
It's my understand that PostgreSQL won't create files largers than
2GB though.

Doing the same tests on the PolyServe file system (psfs) accomplished
the tasks in 117 MB/s and 109 MB/s, just slightly faster.

If you're familiar with Veritas Cluster Server it operates similiar
to it though I didn't have a chance to fully test it.

Given the budget I'd definitely take another look at it.

Greg

Post by Robert Treat
Some basics on how easy it is to install/configure and some before/after type
benchmarks showing how it affected performance. Perferrably you could
measure simple vs. complex queries as well as update vs. insert performance.
If you're really ambitious you could try running one of the tpc style
benchmarks on the system, check the archives or the osdl site for more info
on getting these up and running.
Robert Treat

Robert,
I am currently evaluating PolyServe Matrix Server which is a clustering
solution including a clustered file system (mounted read-write
everywhere).
Anything special anyone wants to know? I'm using PostgreSQL 7.4.2 in
a Linux cluster.
Greg

Post by Kris Kiger
Has anyone heard of clusgres or, better yet, had any experience with it?
I came across it while searching for active clustering projects.
http://www.linuxlabs.com/clusgres.html
Thanks in advance for the info!

I have heard of it but I've not heard of any reports on these lists of
how well it works. If you (or anyone else) gives it a spin please try to
post an account to the list and/or if you send me the info it could
probably make its way on to techdocs.
Robert Treat

--
Greg Spiegelberg
Product Development Manager
Cranel, Incorporated.
Phone: [phone]
Fax: [phone]
Email: ***@cranel.com
Technology. Integrity. Focus. V-Solve!


---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to ***@postgresql.org