Best way for Java/C++/C# to share data in a cache?

Question

I have an order processing application which listens for Order objects to be inserted in a cache. If I want Java, C# and C++ apps to be able to submit orders to that cache, what's the best way to set up that Order object? Orders currently have many Enum member variables. What happens when a C# or C++ app needs to put an Order object in the cache? how would it set those java enums? Also, the java Enum classes have a lot of Java specific code in 'em for convenience. I imagine for cross platform simplicity it might have been best if the Order object were just an array of Strings or a Map of Strings to values but I have too much code depending on the Order object being how it is currently. Should I extract an Order Interface? What about the Enums? My java enums aren't simple {RED,GREEN,BLUE} type enums, they contain references to other Enums, etc. - see below...
A portion of my Order class looks like:
public class Order implements Cloneable, Comparable, java.io.Serializable {
  private static Logger logger = Logger.getLogger(Order.class);
  private boolean clearedFromOpenOrdersTable = false; 
  private boolean trading_opened = false;
  private static Random generator = new Random();
  private static int nextID = generator.nextInt(1000000); //just for testing
  private int quantity = 0;
  private int open = 0;
  private int executed = 0;
  private int last = 0;
  private int cancelPriority = 0;
  private Integer sendPriority = 0;
//enums
  private OrderSide side = OrderSide.BUY;
  private OrderType orderType = OrderType.MARKET;
  private OrderTIF tif = OrderTIF.DAY;
  private OrderStatus orderStatus = OrderStatus.PENDING_NEW;
  private OrderExchange orderExchange = null;
  private OOType ooType = OOType.NOTOO;
  private OOLevel ooLevel = OOLevel.NONE;
  private Float limit = new Float(0);
  private Float stop = null;
  private float avgPx = 0.0f;
  private float lastPx = 0.0f;
  private String account = null;
  private String symbol = null;
  private long submitTimestamp;
  private long fillTime = 0;
  private long ackTime = 0;
  private Timestamp submitSqlTimestamp;
  public /*final*/ static NamedCache cache;
  private ArrayList<OrderStatusChangeListener> statusChangeListeners =
    new ArrayList<OrderStatusChangeListener>();
  transient private Format formatter = new SimpleDateFormat("hh:mm:ss a");
  public static void connectToCache() {
    cache = CacheFactory.getCache("orders");
  public void send() {
    this.submitTimestamp = System.currentTimeMillis() ;
    this.submitSqlTimestamp = new Timestamp(submitTimestamp);
    cache.put(this.ID, this);
  public void setCancelCount(int i) {
    cancelCount = i;
  public int getCancelCount() {
    return cancelCount;
  public static class CancelProcessor extends AbstractProcessor {
    public Object process(InvocableMap.Entry entry) {
      Order o = (Order)entry.getValue();
      if (o.cancelCount == 0) {
        o.cancelCount = 1;
      } else {
        logger.info("ignoring dup. cancel req on " + o.symbol + " id=" + o.ID);
      return o.cancelCount;
  public void cancel() {
      // cache.invoke(this.ID, new CancelProcessor() ); // must this be a 'new' one each time?
      Filter f = new EqualsFilter("getCancelCount", 0);
      UpdaterProcessor up = new UpdaterProcessor("setCancelCount",new Integer(1) );
      ConditionalProcessor cp = new ConditionalProcessor(f, up);
      cache.invoke(ID, cp);
  NumberIncrementor ni1 = new NumberIncrementor("CancelCount", 1, false);
  public void cancelAllowingMultipleCancelsOfThisOrder() {
    System.out.println("cancelAllowingMultipleCancelsOfThisOrder symbol=" + symbol + " id=" + ID);
    cache.invoke(this.getID(), ni1);
  public Timestamp getSubmitSqlTimestamp(){
    return submitSqlTimestamp;
  boolean isWorking( ) {
       // might need to write an extractor to get this from the cache atomically
       if (orderStatus != null &&
            (orderStatus == OrderStatus.NEW || orderStatus == OrderStatus.PARTIALLY_FILLED ||
                // including PENDING_CANCEL breaks order totals from arcadirect
                // because they send a pending cancel unlike foc
                // os.getValue() == OrdStatus.PENDING_CANCEL ||
                orderStatus == OrderStatus.PENDING_NEW ||
                orderStatus == OrderStatus.PENDING_REPLACE)) {
          return true;
        } else {
          return false;
  public long getSubmitTimestamp(){
    return submitTimestamp;
  private void fireStatusChange( ) {
          for (OrderStatusChangeListener x:statusChangeListeners) {
                try {
                     x.dispatchOrderStatusChange(this );
                } catch (java.util.ConcurrentModificationException e) {
                     logger.error("** fireStatusChange: ConcurrentModificationException "+e.getMessage());
                     logger.error(e.getStackTrace());
                     e.printStackTrace();
  public Order() {
      ID = generateID();
      originalID = ID;
  public Object clone() {
      try {
        Order order = (Order)super.clone();
        order.setOriginalID(getID());
        order.setID(order.generateID());
        return order;
      } catch (CloneNotSupportedException e) {
      return null;
    class ReplaceProcessor extends AbstractProcessor {
      // this is executed on the node that owns the data,
      // no network access required
      public Object process(InvocableMap.Entry entry) {
        Order o = (Order)entry.getValue();
        int counter=0;
        float limit=0f;
        float stop=0f;
        int qty=o.quantity;
        boolean limitChanged=false, qtyChanged=false, stopChanged=false;
        for (Replace r:o.replaceList) {
          if (r.pending) {
            counter++;
            if (r.limit!=null) {limit=r.limit; limitChanged=true;}
            if (r.qty!=null) {qty=r.qty; qtyChanged=true;}
            if (r.stop!=null) {stop=r.stop; stopChanged=true;}
        if (limitChanged) o.limit=limit;
        if (qtyChanged) o.quantity=qty;
        if (stopChanged) o.stop=stop;
        if (limitChanged || qtyChanged || stopChanged)
        entry.setValue(o);
        return counter;
  public void applyPendingReplaces() {
     cache.invoke(this.ID, new ReplaceProcessor());
  private List <Replace>replaceList;
  public boolean isReplacePending() {
    if (replaceList==null) return false; 
    for (Replace r:replaceList) {
      if (r.pending==true) return true;
    return false;
  class ReplaceAddProcessor extends AbstractProcessor {
    // this is executed on the node that owns the data,
    // no network access required
    Replace r;
    public ReplaceAddProcessor(Replace r){
      this.r=r;
    public Object process(InvocableMap.Entry entry) {
      Order o = (Order)entry.getValue();
      if (o.replaceList==null) o.replaceList = new LinkedList();
      o.replaceList.add(r);
      return replaceList.size();
  public void replaceOrder(Replace r) {
      //  Order.cache.invoke(this.ID, new ReplaceAddProcessor(r));
      Order o = (Order)Order.cache.get(this.ID);
      if (o.replaceList==null) o.replaceList = new LinkedList();
      o.replaceList.add(r);
      Order.cache.put(this.ID, o);
  public boolean isCancelRequestedOrIsCanceled() {
    // change to cancelrequested lock, not ack lock
    if (canceled) return true;
//  ValueExtractor extractor = new ReflectionExtractor("getCancelCount");
//  int cc = (Integer)cache.invoke( this.ID , extractor );
    Order o = (Order)cache.get(this.ID);
    int cc = o.getCancelCount();
    return cc > 0 || o.isCanceled();
    class Replace implements Serializable{
    boolean pending=true;
    public Float limit=null;
    public Float stop=null;
    public Integer qty=null;
    public Replace() {
  }and then a portion of my OrderExchange.java Enum looks like this:
class SymbolPair implements java.io.Serializable {
  String symbol;
  String suffix;
  SymbolPair(String symbol, String suffix) {
    this.symbol = symbol;
    this.suffix = suffix;
  public boolean equals(Object o) {
    SymbolPair x = (SymbolPair)o;
    return (this.symbol == x.symbol && this.suffix == x.suffix);
  public int hashCode() {
    return (symbol + "." + suffix).hashCode();
  public String toString() {
    if (suffix == null)
      return symbol;
    return symbol + "." + suffix;
public enum OrderExchange implements java.io.Serializable {
  SIM("S", false, '.', OrderTIF.DAY) {
    public String getStandardizedStockSymbol(String symbol, String suffix) {
      return symbol + "." + suffix;
    public SymbolPair getExchangeSpecificStockSymbol(String symbol) {
      return new SymbolPair(symbol, null);
  TSX("c", false, '.', OrderTIF.DAY) {
    public String getStandardizedStockSymbol(String symbol, String suffix) {
      String x = externalSymbolPairToInternalSymbolMap_GS.get(new SymbolPair(symbol, suffix));
      return x == null ? symbol : x;
    public SymbolPair getExchangeSpecificStockSymbol(String symbol) {
      SymbolPair sa = internalSymbolToExternalSymbolPairMap_GS.get(symbol);
      return sa == null ? new SymbolPair(symbol, null) : sa;
  NYSE("N", false, '.', OrderTIF.DAY) {
    public String getStandardizedStockSymbol(String symbol, String suffix) {
      String x = externalSymbolPairToInternalSymbolMap_GS.get(new SymbolPair(symbol, suffix));
      return x == null ? symbol : x;
    public SymbolPair getExchangeSpecificStockSymbol(String symbol) {
      SymbolPair sa = internalSymbolToExternalSymbolPairMap_GS.get(symbol);
      return sa == null ? new SymbolPair(symbol, null) : sa;
  ARCA("C", false, '.', OrderTIF.GTD) {
    public String getStandardizedStockSymbol(String symbol, String suffix) {
      String x = externalSymbolPairToInternalSymbolMap_GS.get(new SymbolPair(symbol, suffix));
      return x == null ? symbol : x;
    public SymbolPair getExchangeSpecificStockSymbol(String symbol) {
      SymbolPair sa = internalSymbolToExternalSymbolPairMap_GS.get(symbol);
      return sa == null ? new SymbolPair(symbol, null) : sa;
  public abstract String getStandardizedStockSymbol(String symbol, String suffix);
  public abstract SymbolPair getExchangeSpecificStockSymbol(String symbol);
  private static Map<SymbolPair, String> externalSymbolPairToInternalSymbolMap_GS = new HashMap<SymbolPair, String>();
  private static Map<SymbolPair, String> externalSymbolPairToInternalSymbolMap_ARCA = new HashMap<SymbolPair, String>();
  private static Map<String, SymbolPair> internalSymbolToExternalSymbolPairMap_GS = new HashMap<String, SymbolPair>();
  private static Map<String, SymbolPair> internalSymbolToExternalSymbolPairMap_ARCA = new HashMap<String, SymbolPair>();
  private static Object[] toArrayOutputArray = null;
  static {
    String SQL = null;
    try {
      Connection c = MySQL.connectToMySQL("xxx", "xxx", "xxx", "xxx");
      SQL = "SELECT symbol, ARCASYMBOL, INETSYMBOL, ARCASYMBOLSUFFIX, INETSYMBOLSUFFIX from oms.tblsymbolnew";
      Statement stmt = c.createStatement();
      ResultSet rs = stmt.executeQuery(SQL);
      while (rs.next()) {
        String symbol = rs.getString("symbol");
        if (rs.getString("ARCASYMBOL") != null) {
          if (!symbol.equals(rs.getString("ARCASYMBOL")) || rs.getString("ARCASYMBOLSUFFIX") != null) {
            String suffix = rs.getString("ARCASYMBOLSUFFIX");
            SymbolPair sp = new SymbolPair(rs.getString("ARCASYMBOL"), suffix);
            internalSymbolToExternalSymbolPairMap_ARCA.put(symbol, sp);
            externalSymbolPairToInternalSymbolMap_ARCA.put(sp, symbol);
    } catch (Exception e) {
      System.out.println(SQL);
      e.printStackTrace();
      System.exit(0);
  static {
    populateSymbolToDestination();
  static Logger logger = Logger.getLogger(OrderExchange.class);
  private static HashMap<String, OrderExchange> symbolToDestination = new HashMap<String, OrderExchange>();
  private final String tag100;
  private final boolean usesSymbolSuffixTag;
  private final char symbolSuffixSeparator;
  private final OrderTIF defaultTif;
  private static final String soh = new String(new char[] { '\u0001' });
  private OrderExchange(String tag100, boolean usesSymbolSuffixTag, char symbolSuffixSeparator, OrderTIF defaultTif) {
    this.tag100 = tag100;
    this.defaultTif = defaultTif;
    this.usesSymbolSuffixTag = usesSymbolSuffixTag;
    this.symbolSuffixSeparator = symbolSuffixSeparator;
  public OrderTIF getDefaultTif() {
    return defaultTif;
  public String getTag100() {
    return tag100;
  public char getSymbolSuffixSeparator() {
    return symbolSuffixSeparator;
  public static OrderExchange getOrderExchangeByExchangeName(String name) {
    for (OrderExchange d : OrderExchange.values()) {
      if (d.toString().equalsIgnoreCase(name.trim())) {
        return d;
    return null;
  Thanks,
Andrew

Answer 1

Hi Andrew
The only way to serialize object, so that they can be used by other languages than Java is to use the Portable Object Format.
The implementation of this requires you to implement the PortableObject interface in Java. PortableObject defines two methods
public void readExternal(PofReader reader);
public void writeExternal(PofWriter writer);
Also you need to add a POF config file that ties the type to a type id.
In C++ each type needs two template methods implemented to seralize and deserialize. But first it needs to register the data type with the same type id as for the Java type using the COH_REGISTER_MANAGED_CLASS macro.
Secondly analogs to Java implement the serializer stubs
template<> void serialize<Type>(PofWriter::Handle hOut, const Type& type);
template<> Type deserialize<Type>(PofReader::Handle hIn);
For C# your serializable types need to implement IPortableObject, with it's two methods:
void IPortableObject.ReadExternal(IPofReader reader);
void IPortableObject.WriteExternal(IPofWriter writer);
Similar to Java C# uses a POF configuration file, the same type id should bind to the corresponding C# type.
For more information see
POF Configuation: http://coherence.oracle.com/display/COH34UG/POF+User+Type+Configuration+Elements
C++: http://coherence.oracle.com/display/COH34UG/Integrating+user+data+types
C#: http://wiki.tangosol.com/display/COHNET33/Configuration+and+Usage#ConfigurationandUsage-PofContext
Hope that helps!
/Charlie
Edited by: Charlie Helin on Apr 30, 2009 12:31 PM