Welcome Guest ( Log In | Register )


 
Reply to this topicNew Topic
How to scale up GI?
Michael Chong
post Jul 23 2010, 07:32 AM
Post #1


Contributor
**

Group: Members
Posts: 11
Joined: 20-March 09
Member No.: 418


Dear GI Experts,
I have 2 questions regarding the scalability of GI:
- First, in the startServer script, what's maximum value that we can set for TE's memory (i.e. Xmx):

set TE_NODE_OPTIONS="-XX:MaxNewSize=48m -XX:NewSize=48m -Xms256m -Xmx256m"

If we have a 8 GB memory server, can we set it to 8 GB?

- Second, is there a guideline on how many TE nodes that we can have on a single server, especially if we have a server with a lot of memory? For example, if we have a 8 GB memory server, how many TE nodes can we have on it?
Go to the top of the page
 
+Quote Post
remery
post Jul 26 2010, 04:36 PM
Post #2


Regular Contributor
***

Group: Members
Posts: 31
Joined: 28-January 09
From: Scottsdale, AZ
Member No.: 301


Hello Michael,

To answer your first question, you should not set you max Heap Size to 8gig. The JVM garbage collection for a heap that size will overwhelm other activity in the JVM. In our experience there is not a need for more than a 2 gig heap size. But, using a heap size over 1 gig will require GC tuning, which is dependent on your trading profile (i.e. msg/sec, payload size, etc).

You second question is difficult to answer. It depends on your hardware, and on your trading profile. The memory on the machine may or may not be the bottleneck. There could be bottlenecks in CPU, disk, network or db.. You may just want to do some testing to see where the sweet spot is in terms of max heap size, and number of te nodes. I can say that the internode communication overhead at 4 nodes starts to get very high. So I would not suggest going any higher than 4 nodes.

-Ric


QUOTE (Michael Chong @ Jul 23 2010, 01:32 AM) *
Dear GI Experts,
I have 2 questions regarding the scalability of GI:
- First, in the startServer script, what's maximum value that we can set for TE's memory (i.e. Xmx):

set TE_NODE_OPTIONS="-XX:MaxNewSize=48m -XX:NewSize=48m -Xms256m -Xmx256m"

If we have a 8 GB memory server, can we set it to 8 GB?

- Second, is there a guideline on how many TE nodes that we can have on a single server, especially if we have a server with a lot of memory? For example, if we have a 8 GB memory server, how many TE nodes can we have on it?

Go to the top of the page
 
+Quote Post

Reply to this topicNew Topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 

Skin designed by IPB Forum Skins