Operation of Search architecture.

Good morning MS community,
 So far i have been done the SharePoint Server 2013 search architecture:
http://technet.microsoft.com/en-us/library/cc263199%28v=office.15%29.aspx
Afterward, i myself interpret the diagram into the image below: This is an operation of SharePoint 2013 search from my understanding.
My question is: "Could you please advise me whether i understand correctly about the "search architecture" - SharePoint 2013 - from my below analytic?"
******************* My analysis of "Search operation " *****************************
1. User enter a string of information that he/she wants to looking for. The string is sent to query components.
2. Query processing components will:
- Analyze the Search queries.
- Perform linguistic processing. Such as "word-breaking" and "stemming".
- Optimize precision, recall, relevancy.
- Submit to index component.
* Later on, index component will gather data from 2 source:
- Crawl and components process.
- Analytic process.
3. Gathering Data from Crawl and components.
3.1.
Crawl component will collect crawling content sources: invoke connectors/ protocol handler to interact with content source to retrieve data.
- Type of data:
+ Actual data.
+ Metadata.
- At the same time, the crawl components will:
+ Store information about crawled items on crawled DB. Crawl component will write the following information to crawl Database:
* Last crawl time.
* Last crawl ID.
* Type of updating during last crawl.
+ Track crawl history.
è After successfully gathering information from content resource, the crawled
data will be sent to "content processing component".
3.2. Content processing component:
- Transform crawled items into "artifacts" that can be included in "search index".
+ How to transform: performing some operation such as "document parsing
and property mapping".
- Perform linguistic process, such as "language detection + entity extraction".
- At the same time, content processing component will write information about "links + URL" to the links database.
è When finish, content processing will send data to index component.
4. Gathering data from Analytic process.
* Explain about components in this part:
4.1. Analytic process component.
- Operations: search analytic + usage analytic.
- Aims: improve search relevance, create search reports, and generate recommendations and deep links.
4.1.1. Search analytic:
- Extracting information
+ Link
+ Number of times clicked.
+ Anchor text.
+ Data related to people.
+ Metadata.
4.1.2. Usage analytic:
- Analyze usage log information. (retrieve this info from the font-end via event store).
è Generate usage and statistic reports, store in "analytics reporting
Database".
4.2. Analytic reporting database.
- Result of usage analytics: usage + statistic reports.
4.3. Link database.
- Store information of:
+ search clicks.
+ Number of times people click on a search result from the search result page.
4.4. Event store:
- Usage events ( such as number of times viewed).
*** operation of "analytic processing component ***
- Get information from "link DB", "analytic DB", "event store".
- Extracting information (links, number of times an items clicked, anchor text, data related to people, metadata …)
- Send information to "index components".
- At the same time, write new information to "link DB" + "analytic DB".
5. "index and query process"
- Receive processed items from "content processing components" "analytic processing components"
è write those items to an index file.
- Send back results to "query processing component".
6. "Query processing component" Return a set (results) based on the processed query back to the query processing component.

Hi,
Search in SharePoint 2013 has been re-architected. You could refer Figure 1 from the link below for big picture of Search process and components:
http://msdn.microsoft.com/en-us/library/office/jj163300(v=office.15).aspx
For some basic concepts, you could refer to:
http://technet.microsoft.com/en-us/library/jj219738(v=office.15).aspx
If you would like more detail information about search, you might need to contact Microsoft support engineer for more sufficient information.
Regards,
Rebecca Tu
TechNet Community Support

Similar Messages

  • What is filter daemon in search index engine? Where can I know all that is needed to know about SharePoint search architecture?

    Going through the search architecture, I found something called filter daemon, I tried looking online for more information about it but people have just reported errors of filtering time out etc. What is it and where can I find detailed information about
    each and every component of enterprise search (considering it will help me understand 2013 search better)

    See if these two links help:
    https://technet.microsoft.com/en-us/library/jj219738.aspx
    https://social.technet.microsoft.com/Forums/sharepoint/en-US/17790f26-0486-40a0-8a07-0f0c6d256799/sharepoint-2013-search-crawl-and-the-filter-daemon?forum=sharepointsearch
    Trevor Seward
    Follow or contact me at...
    &nbsp&nbsp
    This post is my own opinion and does not necessarily reflect the opinion or view of Microsoft, its employees, or other MVPs.

  • How to add new value in operator in search parameter in web ui

    Hi,
    I have a requirement to add values (equal ,not equal ) in operator drop-down field of
    search parameter in search of web ui page.
    Can someone guide me to proceed on this.
    Thanks
    Viren

    Hi,
    here an example how to add operator "contains pattern" to attribute prospect name in the opportunity search.
    Hopefully it will work similar for your issue:
    1) Launch transaction 'sm34'
    2) Enter view cluster name as 'CRMVC_DQ' and click on 'Maintain'
    3) Find DQuery Object Name for example 'BTQOpp' under Comp Name 'BT' and click on'exceptions per attribute.'
    4) Find the Attribute Name for example 'PROSPECT_NAME'
    5) Check the box 'CP' to enable to 'contains' operator.
    Kind regards
    Manfred

  • Opera quick search for archlinux

    I found gentoo has nice search bar for opera http://gentoo-wiki.com/Search_Bar_Plugin#Opera
    I tried to do same for Arch, but I only succeeded with wiki.
    ~/.opera/search.ini
    [Search Engine 11]
    Name=Archlinux wiki
    Verbtext=0
    URL=http://wiki.archlinux.org/index.php/Special:Search?search=%s
    Query=
    Key=aw
    Is post=0
    Has endseparator=0
    Encoding=utf-8
    Search Type=0
    Position=-1
    Nameid=0
    Deleted=0
    I tried to do the same for the aur packages, forum, core and extra packages and bugs w/o any luck.
    Has anyone succeeded in this?
    It would be nice to deliver opera with arch search bar

    I used too many nice hours of the sunday to figure out how the **** this works, puuh. Not once I tried the right click

  • External Operations - Saved Search Mailer Anyone?

    I have an external operation that is performing a saved search mailer. The mail sends and works great, but the urls to the content items are not gatewayed. Is there a setting at the external operation level that can be set so this will happen, or a server configuation option.
    thanks,
    Craig

    Rather, createGatewayLink on
    http://portal.plumtree.com/portal/server.pt/gateway/PTARGS_0_219_12063_2758_0_43/http%3B/prodgadget03.plumtree.com/Gadgets/Department_Customer_Care/Support_Center/html-asp/apiportlets/libraries/plumtree/remote/5.0.1/javadoc/com/plumtree/remote/prc/IPortletBase.html#createGatewayLink(int,%20java.lang.String)

  • Sharepoint Fast Search vs SQL server fulltext index

    HI ,
    I want to kow what is the different between Sharepoint fast search service and Sql server fulltext search?
    Or Can I abstract the Sharepoint fast search from the Sharepoint platform as a isolate component?
    Thank you.
    James

    Please have a look at these links:
    SharePoint Search and FAST Search for SharePoint
    Architecture Diagrams – Fault Tolerance and Performance
    Understand
    FAST Search Logical Architecture for SharePoint 2010
    Full-Text
    Search Architecture
    sqldevelop.wordpress.com

  • Search is not working for MS Word documents

    Hi,
    serious help required for search operation.
    Search operation is not working for MS Word Documents.
    i noticed that, after chekin word documents its status comes as
    GENWWW.
    i already enable file format & extension for word file.
    can somebody help me in this regard.
    Thankx in advance

    Hi
    Please enable the tracing option for :
    requestaudit,indexer
    Enable Full Verbose Tracing .
    Checkin the Ms-Word document and once it fails then check the view server o/p under System Audit Information page and post the error message happening for indexing operation .
    Thanks
    Srinath

  • YOSEMETI-SEARCH DOSEN'T WORK PROPERLY

    Example: COMMAND F- Type a key word in a folder that I know the word is in a file name and it doesn't "find" it. Tried the little drop down criteria menus of "Filename matches: ; Name: Filename or Everything.
    Criteria should always be available which it is not or I can't find it.
    Very annoying. The previous operating systems search engines worked fine.

    Rebuild the Spotlight index. If you try to search now, there will be an indication that indexing is in progress.

  • Can't perform wildcard searches

    Hello world,
    We're using Portal 3.0.9.8.1 with Patch 1949492 installed. This is on 8.1.7.2.4 SE Database.
    When performing a search, cannot include wildcards. E.g. a search for 'test' returns only the exact word 'test'. It does not return 'testing','tester','test1','detests'.
    This is against what Portal's Own Help file states. Click 'Search Tips' on the 'Advanced Search Page' and you are told the following:
    The % character is interpreted literally, so do not include it as a wildcard. If you enter 100% as your search term, search finds content that contains the text 100%, not 1000 or 10000. Wildcards are automatically added to the beginning and end of your search term, so searching for 100 will automatically return content that contains 1000 and 10000.
    If interMedia is installed and enabled, search automatically uses the stem operator to search for words that have the same linguistic root as the specified word. For example, if you specified the word lift, the search feature will return content that contains the words lift, lifting, lifted, etc.
    Both of these statements are blatantly untrue as it does neither.
    Any thoughts Oracle? Has anyone else managed a wildcard search?
    Frustrated
    Dave

    I've just verified in 3.0.9 and wildcards are applied as specified in the documentation, when Text is not enabled. If your search term is 'test' then the SQL query will have the search term %test%. Literal % signs in your search term are escaped, so that if your search term was test% then the query would be for %test^%% escape ^.
    There are a few things to remember. When searching WITHOUT Intermedia Text enabled the search will only match terms in the title and description of the item.
    When, Intermedia Text is enabled, all of the content will be searched. However, as indicated in the documentation, the stem operator will be used. So if you search for 'test' the query is now a Text contains('$test') type query. The default operator is the '$' stem operator, which match terms that have the same linguistic root. So if your search term is 'test' it should match 'tests' or 'testing' or 'tested'. However, it will not match 'test1'. Please refer to the Intermedia Text documenation for more information on the stem operator and Text searching in general.

  • Issue with like operator

    Hi All,
    we are using like operator for search functionality (oracle 10G).
    could any one help me in handling null, when we use like operator.
    Ex:
    select empno,ename,d.deptno
    from emp e, dept d
    where e.deptno = d.deptno
    and e.ename like '%JO%';
    we have a text box in the front end to key in employee name (ename) or part of ename. when user doesnt use this option, he leaves it blank.
    so In the above query, if ename is null then my query fails.
    could anybody help me out in handling this scenario.
    My query should still give me all the employee ids, if the ename is blank.
    using dynamic sql is not advisable.
    Thanks
    Manju

    Something like this ->
    satyaki>select *
      2     from v$version;
    BANNER
    Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Prod
    PL/SQL Release 10.2.0.3.0 - Production
    CORE    10.2.0.3.0      Production
    TNS for 32-bit Windows: Version 10.2.0.3.0 - Production
    NLSRTL Version 10.2.0.3.0 - Production
    Elapsed: 00:00:00.26
    satyaki>
    satyaki>
    satyaki>select *
      2  from emp
      3  where upper(ename) like nvl('%'||upper('&str')||'%',upper(ename));
    Enter value for str:
    old   3: where upper(ename) like nvl('%'||upper('&str')||'%',upper(ename))
    new   3: where upper(ename) like nvl('%'||upper('')||'%',upper(ename))
         EMPNO ENAME      JOB              MGR HIREDATE         SAL       COMM     DEPTNO
          9999 SATYAKI    SLS             7698 02-NOV-08      55000       3455         10
          7777 SOURAV     SLS                  14-SEP-08      45000       3400         10
          7521 WARD       SALESMAN        7698 22-FEB-81       1250        500         30
          7566 JONES      MANAGER         7839 02-APR-81       2975                    20
          7654 MARTIN     SALESMAN        7698 28-SEP-81       1250       1400         30
          7698 BLAKE      MANAGER         7839 01-MAY-81       2850                    30
          7782 CLARK      MANAGER         7839 09-JUN-81       4450                    10
          7788 SCOTT      ANALYST         7566 19-APR-87       3000                    20
          7839 KING       PRESIDENT            17-NOV-81       7000                    10
          7844 TURNER     SALESMAN        7698 08-SEP-81       1500          0         30
          7876 ADAMS      CLERK           7788 23-MAY-87       1100                    20
         EMPNO ENAME      JOB              MGR HIREDATE         SAL       COMM     DEPTNO
          7900 JAMES      CLERK           7698 03-DEC-81        950                    30
          7902 FORD       ANALYST         7566 03-DEC-81       3000                    20
    13 rows selected.
    Elapsed: 00:00:00.02
    satyaki>
    satyaki>/
    Enter value for str: sa
    old   3: where upper(ename) like nvl('%'||upper('&str')||'%',upper(ename))
    new   3: where upper(ename) like nvl('%'||upper('sa')||'%',upper(ename))
         EMPNO ENAME      JOB              MGR HIREDATE         SAL       COMM     DEPTNO
          9999 SATYAKI    SLS             7698 02-NOV-08      55000       3455         10
    Elapsed: 00:00:00.08Regards.
    Satyaki De.

  • Question about setting conditions in searches using SQL

    I am trying to search through a table where the "Score" column hs to be in between two numbers.
    Table Test:
    Name: #
    Tom 40
    Tom 60
    Tom 50
    joe 60
    If i were to search for "Tom" nomally i get all 3 back. Regardless of the code for SQL(assume it works) will the search display only Tom 40 and Tom 50 is i want between 40 and 60? In other words if the condition field has a valid sql expression that works do i need to write anything to display the data in SQl or it will be fixed automatically?

    SQL> select * from test;
    NAME SCORE
    Tom 40
    Tom 60
    Tom 50
    Joe 60
    SQL> select * from test
    2 where name = 'Tom';
    NAME SCORE
    Tom 40
    Tom 60
    Tom 50
    SQL> select * from test
    2 where score between 40 and 60;
    NAME SCORE
    Tom 40
    Tom 60
    Tom 50
    Joe 60
    When you use the 'between' operator the search for score includes both 40 and 60. In case of this example, if you were to display only Tom's scores of 40 and 50, you should use the following select statement.
    Select * from test
    where score >= 40
    and score < 60;
    SQL> Select * from test
    2 where score >= 40
    3 and score < 60;
    NAME SCORE
    Tom 40
    Tom 50

  • RWB Message Monitoring - operation specific

    When looking at message monitoring in RWB, I can't see the actual operation for the message when using operation specific Service Interfaces.
    How can I see the operation for a message in RWB Message monitoring?

    I don't think operation specific search is possible.
    Regards,
    Prateek Raj Srivastava

  • Some Search Admin Pages Causing Exception 0x80131904

    I have a SharePoint 2013 Farm with multiple servers, though most applications, services and sites currently run on the main Front-End system.
    I have been tasked with re-building the Search Architecture, so as to distribute search components across some of the other servers.  During this process, I have been reviewing & documenting the current Search configuration.  However, I keep
    running into an error on several of the Search Admin pages.  I am able to navigate to the "Search Service Application: Search Administration" page, which shows that everything appears healthy under both 'System Status' and 'Search Application
    Topology'
    However, I receive a "Sorry, something went wrong" error message, with "Exception from HRESULT: 0x80131904" page when I click on any of the following links:  "Crawl Log", "Crawl Health Reports", or "Content
    Sources." 
    All the other Quick Links in the Search Administration page appear to work fine.  But other than a "Correlation ID" that I do not know how to use, I can find no other information about this error or how to diagnose it further.
    Anyone know how I can restore access to these Search Administration pages?
    Thanks in advance,
    Elohir

    Hi Elohir,
    You can use the Correlation ID to find more detailed information in logging file, the path of the file is :  C:\Program Files\Common Files\Microsoft Shared\Web Server Extensions\15\LOGS .
    Also , you can see the logging file through Event Viewer (typing Event Viewer in ‘run’).
    0x80131904 is generally happened from SQL Server side. It may be caused by tempdb or Content Database is out of space.
    In addition, here are some similar posts for you to take a look at:
    http://social.technet.microsoft.com/Forums/en-US/62ed2e1f-1d2c-46b2-9a64-ba6b2d65dfdf/exception-from-hresult-0x80131904-in-sharepoint-2013-default-page?forum=sharepointadmin
    http://social.technet.microsoft.com/Forums/en-US/66e600ef-4b40-48a3-bd66-3de8b10e01ba/exception-from-hresult-0x80131904-sharepoint-2010-central-admin?forum=sharepointadminprevious
    http://vbthineshkumar.blogspot.in/2011/11/sql-express-database-full-error-in.html
    http://johanolivier.blogspot.in/2011/04/resolve-sharepoint-errors-caused-by-sql.html
    I hope this helps.
    Thanks,
    Wendy
    Wendy Li
    TechNet Community Support

  • Creating an Architecture Document For a Portal

    I have been asked to come up with an Architecture Document for a public facing SharePoint 2010 site.  I am familiar with the SharePoint 2010 technologies, however I need a starting point on where and how to start the Architecture document.  Is there any Architecture Template Document that exists so that I can use them?

    Hi
    I cannot share the full and final doc with you but following Index will help you creating the Architecture document from the scratch
    1     Document Overview............................................................................................................ 7
    1.1     Scope............................................................................................................................... 7
    1.2     Audience......................................................................................................................... 7
    2     Logical Architecture............................................................................................................ 9
    2.1     Overview.......................................................................................................................... 9
    2.2     Diagram........................................................................................................................... 9
    2.3     Component Description.............................................................................................. 9
    3     Physical Architecture....................................................................................................... 11
    3.1     Overview....................................................................................................................... 11
    3.2     Production Environment.......................................................................................... 11
    3.2.1     Diagram................................................................................................................... 11
    3.2.2     Component Description....................................................................................... 12
    3.2.3     Hardware Requirements...................................................................................... 14
    3.2.4     Software Requirements........................................................................................ 14
    3.3     Staging Environment................................................................................................. 14
    3.3.1     Diagram................................................................................................................... 15
    3.3.2     Component Description....................................................................................... 15
    3.3.3     Hardware Requirements...................................................................................... 15
    3.3.4     Software Requirements........................................................................................ 16
    3.4     Development & Test Environment......................................................................... 16
    3.4.2     Diagram................................................................................................................... 16
    3.4.3     Component Description....................................................................................... 17
    3.4.4     Hardware Requirements...................................................................................... 17
    3.4.5     Software Requirements........................................................................................ 18
    4     Non-Functional Requirements....................................................................................... 19
    4.1     Security......................................................................................................................... 19
    4.1.1     Requirements......................................................................................................... 19
    4.1.2     Authentication........................................................................................................ 19
    4.1.3     Authorization.......................................................................................................... 19
    4.2     Availability..................................................................................................................... 21
    4.2.1     Requirements......................................................................................................... 21
    4.2.2     Hardware Redundancy and Failover................................................................. 22
    4.2.3     Scaling Logical SharePoint Components......................................................... 22
    4.2.4     Disaster Recovery.................................................................................................. 22
    4.3     Performance................................................................................................................. 23
    4.3.1     Requirements......................................................................................................... 23
    4.3.2     Performance & Capacity Expectations.............................................................. 23
    4.3.3     Size and Volume Assumptions.......................................................................... 23
    4.3.4     Performance Testing Approach.......................................................................... 25
    4.3.5     Performance Tuning Approach.......................................................................... 25
    4.3.6     Monitoring and Reporting.................................................................................... 26
    4.4     Accessibility................................................................................................................. 26
    4.4.1     Requirements......................................................................................................... 26
    4.4.2     Internal Access....................................................................................................... 26
    4.4.3     Remote Access...................................................................................................... 26
    4.5     Auditing & Reporting................................................................................................. 27
    4.5.1     Requirements......................................................................................................... 27
    4.5.2     Approach................................................................................................................. 27
    4.5.3     Audit Reports.......................................................................................................... 27
    4.5.4     Diagnostic Logging............................................................................................... 28
    4.5.5     Portal Usage Reporting........................................................................................ 28
    4.6     Exception Handling & Logging............................................................................... 28
    4.6.1     Exception Handling............................................................................................... 28
           Application..................................................................................................................... 29
    4.6.2     Logging.................................................................................................................... 29
    4.7     Caching......................................................................................................................... 29
    4.7.1     Disk based caching for BLOBs........................................................................... 29
    4.7.2     Client-side caching............................................................................................... 30
    4.7.3     Object Caching...................................................................................................... 30
    4.8     Maintainability.............................................................................................................. 31
    4.8.1     Backup and Restore.............................................................................................. 31
    4.8.2     Archiving & Purging.............................................................................................. 32
    4.9     Regional Deployment................................................................................................ 32
    4.9.1     Conceptual Diagram............................................................................................. 32
    4.9.2     Feature Summary.................................................................................................. 33
    4.10      Service Management.............................................................................................. 35
    5     Search Architecture.......................................................................................................... 36
    5.1     Introduction.................................................................................................................. 36
    5.2     Key Design Considerations..................................................................................... 37
    5.2.1     Distributed Geographical Deployment............................................................... 37
    5.2.2     Content Sources.................................................................................................... 37
    5.2.3     Availability & Performance................................................................................... 37
    5.2.4     Physical Infrastructure.......................................................................................... 38
    5.2.5     Search as a Shared Service................................................................................ 38
    5.3     Search Architecture in portal..................................................................................... 38
    6     Content Deployment Architecture................................................................................ 41
    6.1     Introduction.................................................................................................................. 41
    6.2     Key Design Considerations..................................................................................... 41
    6.2.1     Distributed Geographical Deployment............................................................... 41
    6.2.2     Security.................................................................................................................... 42
    6.2.3     Availability............................................................................................................... 42
    6.2.4     Publishing Frequency.......................................................................................... 42
    6.2.5     Physical Infrastructure.......................................................................................... 42
    6.2.6     User Contributed Content.................................................................................... 42
    6.3     Content Deployment in portal................................................................................... 43
    7     References.......................................................................................................................... 45
    8     Key Decisions.................................................................................................................... 46
    9     Dependencies.................................................................................................................... 47
    10      Key Contacts................................................................................................................... 48
    11      Appendix A – Active Directory Requirements........................................................ 49
    12      Appendix B – Capacity Sizing Model........................................................................ 51
    13      Appendix C – Hardware & Software Requirement Summary............................. 53
    14      Appendix D – Site Architecture................................................................................... 55
    Regards
    Deepak Aggarwal

  • Searching from beginning of a line/string with Oracle Text ...

    Oracle Database 10.2.0.3, Solaris
    Hi,
    what sounds very easy with the LIKE operator seems to be impossible with the Oracle Text Operator Contains ;
    Searching for 'Deutsche%' results with LIKE ->
    'Deutsche Bank'
    'Deutsche Post'
    'Deutsche Oracle Community'
    But with Contains-Operator which is token based the result is following ('$Deutsche%')
    'Deutsche Bank'
    'Armin Deutscher'
    We want to get results starting with 'Deutscher...' But with Contains and some configuration i did not find a way. Combining LIKE with Contains did not help too because Contains expands the word in more instances then LIKE.
    Indexed Columns are varchar2 typed
    any idea?
    kind regards
    Karl
    Message was edited by:
    kreitsch

    Have you evaluated the query rewrite template with CONTAINS?
    http://download.oracle.com/docs/cd/B19306_01/text.102/b14218/csql.htm#sthref122

Maybe you are looking for

  • GP70 screen too bright

    Hi, I just bought a GP70 2PE with Core i7 and so far I quite like it. I installed Windows 7 x64 instead of the default Windows 8. However, I have one problem with it - the screen is very bright - even on the lowest setting, the screen is brighter tha

  • Need Step by step installation guide for Cisco ISE in distributed environment.

                 Hi Friends, If anyone is having  step by step installation guide for Cisco ISE in distributed environment please shere! I have user guide from Cisco, but does someone have created at the time of actual installation. Thanks, Sachin

  • Obiee11.1.1.5.0(Software Only Install) windows 7  64bit Installation Error

    Hi, I have installed obiee11.1.1.5.0 on windows 7 OS with 64bit,while instalation i got below attached error..after that can't able to see sample dashboard on dahsboard page but all services are up only also i can able to login RPD in online mode,as

  • HHow to create a keyline around the document perimeter

    Hey guys, I am trying to create a keyline around the document instead of using the crop mark. I would like to automate this task for each documents for any size I create. Does somebody tried to set up a applescript for that? I found a bunch of script

  • CD changer won't recognize cds burned in itunes

    OK, so my cd changer is pretty old, but it's a really good one that I'd like to keep. However, it doesn't recognize any of the cds I've burned in itunes. I've tried burning in both the aac and mp3 formats. Is there anything I can do about this withou