Endeca commerce 3.1.1 can't support Chinese segmentation also?

Question

Dear experts:
I am do a PoC base on the sample discover project. After specifiy the language to Chinese,I can only search the chinese content between Punctuations, take a long description of a product for example,
优质性能
品质画面: 在QVGA分辨率（640×480像素，软件增强）捕捉清晰的视频和图像.
品质声音: 使用耳机享受清晰，层次分明的谈话。无需购买额外的设备.
便利的
支持流行的即时消息应用程序: 是进行Skype™视频理想伴侣的.
通用管理面板：: 轻松安装在任何类型的显示器或笔记本电脑.
I can only get this product by searching the keyword '优质性能' not '优质'
Any of your response will be very appreciated.
what I have configured is：
For data source:
I changed the property 'product.long_desc' of first one record to chinese and load it to MDEX by baseline_update and promote_content (can read it from the web application)
For Forge：
specify the encoding of source data to UTF-8 and specify the per-property language ID for property 'product.long_disc' in the Forge pipeline.
For Digdx
specify the language in DataIngest.xml as below:
- <dgidx id="Dgidx" host-id="ITLHost">
- <properties>
<property name="numLogBackups" value="10" />
<property name="numIndexBackups" value="3" />
</properties>
- <args>
<arg>-v</arg>
<arg>--compoundDimSearch</arg>
<arg>--lang</arg>
<arg>zh-CN</arg>
</args>
<log-dir>./logs/dgidxs/Dgidx</log-dir>
<input-dir>./data/forge_output</input-dir>
<output-dir>./data/dgidx_output</output-dir>
<temp-dir>./data/temp</temp-dir>
<run-aspell>true</run-aspell>
</dgidx>
</spr:beans>
and add the file Disvover.spell_config.xml with below content:
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE SPELL_CONFIG SYSTEM "spell_config.dtd">
<SPELL_CONFIG>
<SPELL_ENGINE>
<DICT_PER_LANGUAGE>
<ESPELL/>
</DICT_PER_LANGUAGE>
</SPELL_ENGINE>
</SPELL_CONFIG>
For the Dgraph:
specify the language in DgraphDefaults.xml as below:
- <dgraph-defaults>
- <properties>
<property name="srcIndexDir" value="./data/dgidx_output" />
<property name="srcIndexHostId" value="ITLHost" />
<property name="srcPartialsDir" value="./data/partials/forge_output" />
<property name="srcPartialsHostId" value="ITLHost" />
<property name="srcCumulativePartialsDir" value="./data/partials/cumulative_partials" />
<property name="srcCumulativePartialsHostId" value="ITLHost" />
<property name="srcDgraphConfigDir" value="./data/workbench/dgraph_config" />
<property name="srcDgraphConfigHostId" value="ITLHost" />
<property name="numLogBackups" value="10" />
<property name="shutdownTimeout" value="30" />
<property name="numIdleSecondsAfterStop" value="0" />
</properties>
- <directories>
<directory name="localIndexDir">./data/dgraphs/local_dgraph_input</directory>
<directory name="localCumulativePartialsDir">./data/dgraphs/local_cumulative_partials</directory>
<directory name="localDgraphConfigDir">./data/dgraphs/local_dgraph_config</directory>
</directories>
- <args>
<arg>--threads</arg>
<arg>2</arg>
<arg>--whymatch</arg>
<arg>--spl</arg>
<arg>--dym</arg>
<arg>--dym_hthresh</arg>
<arg>5</arg>
<arg>--dym_nsug</arg>
<arg>3</arg>
<arg>--stat-abins</arg>
<arg>--lang</arg>
<arg>zh-CN</arg>
</args>
<startup-timeout>120</startup-timeout>
</dgraph-defaults>
</spr:beans>
Best Regards
Vicky
what I have configured is：
For data source:
I changed the property 'product.long_desc' of first one record to chinese and load it to MDEX by baseline_update and promote_content (can read it from the web application)
For Forge：
specify the encoding of source data to UTF-8 and specify the per-property language ID for property 'product.long_disc' in the Forge pipeline.
For Digdx
specify the language in DataIngest.xml as below:
- <dgidx id="Dgidx" host-id="ITLHost">
- <properties>
<property name="numLogBackups" value="10" />
<property name="numIndexBackups" value="3" />
</properties>
- <args>
<arg>-v</arg>
<arg>--compoundDimSearch</arg>
<arg>--lang</arg>
<arg>zh-CN</arg>
</args>
<log-dir>./logs/dgidxs/Dgidx</log-dir>
<input-dir>./data/forge_output</input-dir>
<output-dir>./data/dgidx_output</output-dir>
<temp-dir>./data/temp</temp-dir>
<run-aspell>true</run-aspell>
</dgidx>
</spr:beans>
and add the file Disvover.spell_config.xml with below content:
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE SPELL_CONFIG SYSTEM "spell_config.dtd">
<SPELL_CONFIG>
<SPELL_ENGINE>
<DICT_PER_LANGUAGE>
<ESPELL/>
</DICT_PER_LANGUAGE>
</SPELL_ENGINE>
</SPELL_CONFIG>
For the Dgraph:
specify the language in DgraphDefaults.xml as below:
- <dgraph-defaults>
- <properties>
<property name="srcIndexDir" value="./data/dgidx_output" />
<property name="srcIndexHostId" value="ITLHost" />
<property name="srcPartialsDir" value="./data/partials/forge_output" />
<property name="srcPartialsHostId" value="ITLHost" />
<property name="srcCumulativePartialsDir" value="./data/partials/cumulative_partials" />
<property name="srcCumulativePartialsHostId" value="ITLHost" />
<property name="srcDgraphConfigDir" value="./data/workbench/dgraph_config" />
<property name="srcDgraphConfigHostId" value="ITLHost" />
<property name="numLogBackups" value="10" />
<property name="shutdownTimeout" value="30" />
<property name="numIdleSecondsAfterStop" value="0" />
</properties>
- <directories>
<directory name="localIndexDir">./data/dgraphs/local_dgraph_input</directory>
<directory name="localCumulativePartialsDir">./data/dgraphs/local_cumulative_partials</directory>
<directory name="localDgraphConfigDir">./data/dgraphs/local_dgraph_config</directory>
</directories>
- <args>
<arg>--threads</arg>
<arg>2</arg>
<arg>--whymatch</arg>
<arg>--spl</arg>
<arg>--dym</arg>
<arg>--dym_hthresh</arg>
<arg>5</arg>
<arg>--dym_nsug</arg>
<arg>3</arg>
<arg>--stat-abins</arg>
<arg>--lang</arg>
<arg>zh-CN</arg>
</args>
<startup-timeout>120</startup-timeout>
</dgraph-defaults>
</spr:beans>
Best regards
Vicky

Answer 1

Hi
I can't see anything wrong with your configuration - I'd recommend you raise an SR at support.oracle.com for this.
Michael