Can moving large sharepoint lists to database and using database table as an external list help performance?

Hi All,
I have to maintain a huge SharePoint 2010 list with more than 700,000 items in it. The items are data records(not documents) and are distributed among a number of folders. There are also a number webparts that are currently using this list. As you can imagine
the performance of queries on the list have degraded considerably. Even opening the folders with too many items in them takes quite some time. We are looking for a solution for this situation and some people suggested to move the list items to a SQL Server
table and make an external list representing the original list. They think this way the changes that we have to make in the webparts source codes will be minimal.
I am not sure if this is the best solution as I have heard about slow external lists. Do you think using the external list instead of our current list improves the performance? Do you think this is the right solution for us?
I would be grateful if you tell me your ideas to solve this problem.
Thanks in advance

"right solution for us" is hard to solve without more info.
SharePoint list items can include things like version history, content approval, audit tracking, and more... such things are NOT built into SQL.
BCS is an option, and generally changing a list CAN have a very minimal impact (making many assumptions about how it's used)...
BCS also incurs an overhead of the lookup (since it's external). And there are record limits (defaults at a minimum).
And more importantly, SharePoint *can* handle large lists... if done appropriately... but can also be mis-handled.
The limits imposed on large lists by SharePoint, are largely attributable DIRECTLY BACK TO SQL (specifically, the number of records that can be obtained with ROW locks before switching to PAGE locks or TABLE locks, which have LARGER impacts).
So again, BCS is an option, but whether it's the "right solution for us" is more dependent. Plus, you would probably also benefit by spending some time investigating the other uses (web parts/etc) for opportunities to improve their performance,
user experience, etc.
Scott Brickey
MCTS, MCPD, MCITP
www.sbrickey.com
Strategic Data Systems - for all your SharePoint needs

Similar Messages

Where to find the Siebel OLTP Database and OBAW database after downloading

Hi All,
I downloaded Oracle Apps 7.9.6.1 (424114 KB) and i'n not able to see the following
1. Prebuilt dashboards and reports
2. OLTP DB and DW DB
Do i need to download them seperately from somewhere.
Thanks in Advance.
Jaan

Hi All,
My objective is to query the transactional database and the Datawarehouse tables. Could some please help me in finding these tables in OBIEE Apps. I'm not able to update rows in repository as well.
Any help appreciated.
Thanks
Jaan

How can I delete all of my contacts from my iphone? I have updated my contact list in Outlook, and need to re-import that "clean" list.

How can I delete all of my contacts from my iphone? I have updated my contact list in Outlook, and need to re-import that "clean" list.

There is a checkbox on the 'info' tab in iTunes that will allow you to overwrite the address book on the phone with the one from the computer on the next sync.

I am using Mavericks. I had a list of VIPS and used it extensively. Now it has disappeared and VIPs on the menu bar is faded. There is nil response to VIP in help. Can you tell me what has happened?

I am using Mavericks. In Mail I had a list of VIPS and used it extensively. Now it has disappeared and VIPs on the menu bar is faded. There is nil response to VIP in help. Can you tell me what has happened?

Triple-click anywhere in the line below on this page to select it:
~/Library/Mail/V2/MailData/VIPSenders.plist
Right-click or control-click the highlighted line and select
Services ▹ Show Info in Finder (or just Show Info)
from the contextual menu.* An Info dialog should open.
Does the dialog show "You can read and write" in the Sharing & Permissions section?
In the General section, is the box labeled Locked checked?
What is the Modified date?
If you don't have read and write access to the item, change the settings as directed here. Note, however, that if one file has wrong access settings, most likely others do as well. If the item is locked, unlock it.
*If you don't see the contextual menu item, copy the selected text to the Clipboard by pressing the key combination command-C. Open a TextEdit window and paste into it (command-V). Select the line you just pasted and continue as above.

Ok, so I have a PC and recently downloaded the newest version of iTunes. Somehow I canno't find my video Podcasts anywhere except for the recently played videos. Where can I first of all find them and secondly view them like in a list or gallery?

Ok, so I have a PC and recently downloaded the newest version of iTunes. Somehow I canno't find my video Podcasts anywhere except for the recently played videos. Where can I first of all find them and secondly view them like in a list or gallery?

replying to JS1111
Now I only get one HKEYLOCALMACHINE\Software\
QuicktimePlayerLib.QuicktimePlayerApp\CLSID.
some folks have been having some success with pgfpdwife's technique in the following post:
pgfpdwife: Re: Could not open key HKEYLOCALMACHINE\Software\Classic\Quicktime.Quicktime\
note carefully that the technique involves a registry edit. be sure to make a backup of any keys you edit. if you're unfamiliar with your registry or registry editing, head to your XP help and support, do a search on registry, and read through the articles that come up.
There are also some instructions on how to back up registry keys in the following document:
Error 1406 or 1402 appears when you install iTunes or QuickTime for Windows

SQL Server Reporting Services installed on a production database server used to support JD Edwards EnterpriseOne. What performance isses can arise

SQL Server Reporting Services installed on a production database server used to support JD Edwards EnterpriseOne. What performance isses can arise. Is it recommended. What are the pros and cons

Hi hazelannc,
I am trying to involve someone more familiar with this topic for a further look at this issue. Sometime delay might be expected from the job transferring. Your patience is greatly appreciated. Thank you for your understanding and support.
Regards,
Katherine Xiong
Katherine Xiong
TechNet Community Support

How to conncet mysql database and oracle database 11g2 on linux 5.4

Hi,
Can anyone help me to connect mysql server database to Oracle
database on Linux OS?
I have done all things, but I am getting a problem in installing dg4odbc
driver on Oracle database. In a simple word, I don't know how to create
listener between mysql database and Oracle database.
If anyone knows that please help me in configuring dg4odbc for Oracle. OS
-Linux 5.4 and refer any doc or link.
oracle 11g2 11.2.0.1
i follow the metalink id - 466228.1 ( but cant successed).
Thanks and regards,
pritesh ranjan

hi pl z clear me it is required to install manully the dg4odbc driver for oracle to connect MySQL server database. because in my $ORACLE_HOME/hs/admin/initdg4odbc.ora is present automatically.
details of the initdg4odbc.ora
# This is a sample agent init file that contains the HS parameters that are
# needed for the Database Gateway for ODBC
# HS init parameters
HS_FDS_CONNECT_INFO = mysql_odbc
HS_FDS_TRACE_LEVEL = off
HS_FDS_SHAREABLE_NAME = /usr/lib/libmyodbc5w.so
# ODBC specific environment variables
set ODBCINI=/etc/odbc.ini
set LD_LIBRARY_PATH=/usr/lib
# Environment variables required for the non-Oracle system
#set HOME=/home/oracle
~
~
~
"initdg4odbc.ora" 20L, 437C
details of the listener.ora file
DG4ODBC =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = localhost)(PORT = 1521))
(CONNECT_DATA=(SID=dg4odbc))
(HS=OK)
SID_LIST_ORCL =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME = orcl)
(ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_1)
(SID_NAME = ORCL)
ADR_BASE_DG4ODBC = /u01/app/oracle
ORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = pritesh11gprim.oracle.com)(PORT = 1521))
ADR_BASE_ORCL = /u01/app/oracle
"listener.ora" [readonly] 37L, 779C 35,0-1 85%
details of tnsname.ora file
# tnsnames.ora Network Configuration File: /u01/app/oracle/product/11.2.0/dbhome_1/network/admin/tnsnames.ora
# Generated by Oracle configuration tools.
ORCL =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.1.132)(PORT = 1521))
(CONNECT_DATA =
(SERVICE_NAME = ORCL)
DG4ODBC =
(DESCRIPTION=
(ADDRESS=(PROTOCOL=tcp)(HOST=localhost)(PORT=1521))
(CONNECT_DATA=(SID=DG4ODBC))
(HS=OK)
MYSQL =
(DESCRIPTION=
(ADDRESS=(PROTOCOL=tcp)(HOST=localhost)(PORT=1521))
(CONNECT_DATA=(SID=MYSQL))
(HS=OK)
when i m going to start the listener it could not be started..
details of the mysql server database
[root@pritesh11gprim ~]# mysql -u root -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.6.10 MySQL Community Server (GPL)
Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.
Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
mysql>
mysql> show databases;
| Database |
| information_schema |
| demo |
| mysql |
| performance_schema |
| pritesh |
| test |
6 rows in set (0.01 sec)
if any where i m wrong then plz suggest me......
thanks & regards
pritesh ranjan

Can anybody tell me about SD Functionality and the main tables used in SD

Hi,
Can anybody tell me about SD Functionality and the main tables used in SD.
Thanks,
bsv.

Hi
SD FLOW
SD Flow Cycle:
INQUIRY ( VA11)
|
QUOTATION (VA21)
|
PURCHASE ORDER (ME21)
|
ORDER CONFIRMATION (VA01)
|
PICKING LIST (VL36)
|
PACKING LIST - (VL02, VL01)
|
SHIPPING (VT01)
|
INVOICE (VF21, VF01)
|
AR
Enquiry - Customer enquires about the Products services that were sold by a company - VA11
Quotation - Company Gives a Quotation for the products and Services to a Customer
Sales Order - Customer gives a Purchase order to the company agaionst which a Sales order will be raised to Customer in SAP.
VBAK: Sales Document(Header Data) (VBELN)
VBAP: Sales Document(Item Data) (VBELN,POSNR,MATNR,ARKTX,CHARG)
      Enquiry, Quotation, Sales Order are differentiated based on Doc.
      Type(VBTYP field) in VBAK,VBAP Tables( for Enquiry VBTYP = A,
      for Quotation 'B' & for Order it is 'C'.)
Delivery(Picking, Packing, Post Goods Issue and Shipment)->
Company sends the material after picking it from Godown and Packing it in a Handling Unit(box) and Issues the goods
LIKP: Delivery Table (Header Data)(VBELN,LFART,KUNNR,WADAT,INCO1)
LIPS: Delivery Table (Item Data)(VBELN,POSNR,WERKS,LGORT,MATNR,VGBEL)
      (LIPS-VGBEL = VBAK-VBELN, LIPS-VGPOS = VBAP-POSNR)
Billing - Also company bills to the customer for those deliveries
And in FI against this billing Accounting doc is created.
VBRK: Billing Table(Header Data)(VBELN,FKART,BELNR)
VBRP: Billing Table(Item Data)(VBELN,POSNR,FKIMG,NETWR,VGBEL,VGPOS)
      (VBRP-AUBEL = VBAK-VBELN, VBRP-VGBEL = LIKP-VBELN)
      Apart from these tables there are lot of other tables which starts with
      V, but we use the following tables frequently.
other tables and imp fields
VBUK: All Sales Documents status & Admn. Data(Header)(VBELN,VBTYP)
      VBTYP= C(Sales Order) VBTYP=J(Delivery) VBTYP=M(Invoice)
VBUP: Sales Documents status & Admn. Data(Item)(VBELN,POSNR)
VBEP: Sales Doc. Schedule Lines Data(VBELN,POSNR,EDATU,WMENG)
VBKD: To get sales related Business data like Payment terms etc.(VBELN,ZTERM)
VBFA: sales document flow data(VBELV,VBELN,POSNV,VBTYP)
VBPA: Partner functions Data(VBELN,PARVW,KUNNR,LIFNR)
VEDA: Contract Data(VBELN,VPOSN)
VEDAPO: Contract Data(VBELN,VPOSN)
KONA: Rebate Agreements (KNUMA,VKORG,VTWEG,SPART)
VBRL: SD Document: Invoice List(VBELN,POSNR,VBELN_VF,NETWR,KUNAG)
VKDFS: SD Index: Billing Indicator(FKTYP,VBELN,FKART,VKORG)
VBSK: Collective Processing for a Sales Document Header(SAMMG,SMART)
VBSS: Collective Processing: Sales Documents(SAMMG,VBELN,SORTF)
VRKPA: Sales Index: Bills by Partner Functions(VBELN,BELNR,KUNDE,PARVW)
VRPMA: SD Index: Billing Items per Material(MATNR,VBELN,BELNR,KUNNR)
TVLKT: Delivery Type: Texts(LFART,VTEXT)
KNA1: Customer Master-General(KUNNR,NAME1,LAND1)
KNB1: Customer Master(Company Code)(KUNNR,BUKRS,PERNR)
KNC1: Customer Master Data (Transaction Figures)(KUNNR,BUKRS,GJAHR)
KNVK: Customer Master Contact Partner(PARNR,KUNNR,NAME1)
KNVV: Customer Master sales data(KUNNR,VKORG,VTWEG,KDGRP)
KNBK: Customer Bank Details(KUNNR,BANKS,BANKL,BANKN)
KNVH: Customer Hierarchy (HITYP,KUNNR,VKORG,VTWEG,SPART)
KNVP: Customer Master Partner Functions(KUNNR,PARVW,KUNN2)
KNVS: Customer Shipment data(KUNNR,VSTEL,TRANS)
KNVI: Customer Tax data(KUNNR,ALAND,TATYP)
LFA1: Vendor Master-General (LIFNR,NAME1,ORT01)
LFB1: Vendor Master(Company Code)(LIFNR,BUKRS,PERNR)
LFC1: Vendor Master (Transaction Figures)(LIFNR,BUKRS,GJAHR)
MARA: Material Master-General (MATNR,MTART,MATKL)
MARC: Material Master-Plant data(MATNR,WERKS,EKGRP)
MARD: Material Master- St.Location Data(MATNR,WERKS,LGORT,LABST)
EBEW: Sales Order Stock Valuation(MATNR,VBELN,BWKEY,BWTAR)
TVKO: Sales Organizations(VKORG)
TVTW: Distribution Channel(VTWEG)
TSPA: Divisions(SPART)
TVKOV: Distribution Channels for S.Orgn(VKORG,VTWEG)
TVKOS: Divisions for S.Orgn(VKORG,SPART)
TVTA: Sales Areas(VKORG,VTWEG,SPART)
TVBUR: Sales Offices(VKBUR,ADRNR)
TVKBT: Sales Office Texts(VKBUR,SPRAS,BEZEI)
TVKBZ: Sales Office Assign.to Sales Area(VKORG,VTWEG,VKBUR)
TVKGR: Sales Group(VKGRP)
TVGRT: Sales Group Texts(VKGRP,SPRAS,BEZEI)
TVBVK: Sales Group to Sales office(VKBUR,VKGRP)
TVKWZ: Plants Assign.to S.Orgn(WERKS,VKORG)
T171T: Sales District Texts(BZIRK,BZTXT,SPRAS)
TVLA: Loading Points(LSTEL)
TVST: Shipping Points (VSTEL)
TVSWZ: Shipping Point to Plant(VSTEL,WERKS)
TVPT: Item Categories (PSTYV)
TINC: Customer Incoterms(INCO1)
T077D: Customer Account Group (KTOKD)
T001W: Plants (WERKS)
T001L: Storage Locations (LGORT)
T499S: Locations(WERKS,STAND,KTEXT)
TWLAD: To get address of Storage Location and Plant(LGORT,ADRNR)
TVAK: Sales Document (Order) Types (AUART)
TVAU: Sales Documents: Order Reasons (AUGRU)
TVFK: Billing Document Types (FKART)
TVLK: Delivery Types(LFART)
TVSB: Shipping Conditions (VSBED)
TTDS: Transportation Points(TPLST)
TVKT: Account Assignment Groups (KTGRD)
KONV: Condition Types pricing)(KNUMV,KSCHL,KWETR)
ADRC: To get Addresses of Partners(ADDRNUMBER,NAME1)
VBBE: Sales Requirements: Individual records(VBELN,POSNR,MATNR)
VBBS: Sales Requirement totals Record(MATNR,WERKS,LGORT,CHARG)
VBKA: Sales Activities Data(VBELN,KTAAR)
VBPV: Sales Document Product Proposal(VTWEG,MATNR,KUNNR,CHARG)
T682: Access Sequences (KOZGF)
T682T: Access Sequence Texts (KOZGF,VTXTM)
T683: Pricing Procedures (KALSM)
T683T: Pricing Procedures Texts(KALSM,KAPPL,SPRAS,VTEXT)
T685: Pricing Condition Types (KSCHL)
T685T: Condition Type Texts(KSCHL,SPRAS,KAPPL,VTEXT)
KONH: Conditions (Header)(KNUMH,KAPPL,KSCHL)
KONP: Conditions (Item)(KNUMH,KOPOS,KAPPL,KSCHL)
KONV: Conditions (Transaction Data)(KNUMV,KSCHL,KBERT,KWERT)
KOND: Conditions (KNUMD,ZUSKO,KSCHL)
for sd go through the links
http://www.sapgenie.com/abap/tables_sd.htm
Please check this SD online documents.
http://help.sap.com/printdocu/core/Print46c/en/data/pdf/CAARCSD/CAARCSD.pdf
http://help.sap.com/printdocu/core/Print46c/en/data/pdf/MYSAP/SR_SD.pdf
http://help.sap.com/printdocu/core/Print46c/en/data/pdf/BCBMTWFMSD/BCBMTWFMSD.pdf
http://help.sap.com/printdocu/core/Print46c/en/data/pdf/LOLISPLN/LOLISPLN.pdf
Also please check this SD links as well.
http://help.sap.com/saphelp_47x200/helpdata/en/92/df293581dc1f79e10000009b38f889/frameset.htm
http://help.sap.com/saphelp_erp2005/helpdata/en/dd/55f33e545a11d1a7020000e829fd11/frameset.htm
http://www.sap-basis-abap.com/sapsd.htm
http://www.sap-img.com/sap-sd.htm
http://www.sapgenie.com/abap/tables_sd.htm
http://searchsap.techtarget.com/featuredTopic/0,290042,sid21_gci961718,00.html
http://www.sapbrain.com/TUTORIALS/FUNCTIONAL/SD_tutorial.html
All help ebooks are in PDF format here
http://www.easymarketplace.de/online-pdfs.php
Reward points if useful
Regards
Anji

Had to uninstall iWork trial since I bought the pages app and it wouldn't let me print or save. Now the app store says I have pages installed but I can't find it anywhere to open and use it. I'm not very computer savvy and am getting frustrated!

Ooops, guess I didn't need to post everything in the title - sorry! I bought the pages app - but couldn't save or print so with some online searching found that I had to uninstall the iWork trial which had expired. I did that - but now I can't figure out how to re-install the pages app!! The app store says it's installed, but I can't find it anywhere to open and use it. I'm not very computer savvy - and am a first time Mac user and am getting extremely frustrated! I e-mailed some help center and they can't seem to help me either. I would appreciate any help/advice that can fix my problem - thanks in advance!!

OK Apple has stuffed up the demo version upgrade process so the first thing you need to do is get rid of the demo.
That includes getting rid of the files in the system.
The instructions how to do that are here:
Note That where you see / that is the sequence of folders, each nested inside each other.
User/Library/Preferences the com.apple.iwork.Keynote.plist
Means the User (you, the little home icon, whatever you are called on your computer) then the Library folder inside that and then the Preferences folder inside that.
Lion initially hides the System folders from you so you have to go to the Finder > Menu > hold down the option key and click on GO > Library to see it.
Peter

Include or create a view in the database and use this view?

Well, I need to get related data of the main table from another related tables, so one way to do that is to use the Include method in Entity Framework to get this related data.
However, I am thinking in another option, create a view in the database and use this view in entity framework. In this way, I avoid the needed of the include, because I think that is expensive in resources. But I am no very sure about that.
I would like to know if the use of views on entity framework is a good idea to improve the performace or is better to use the include.
For example, if I use the include I have the advantage that I get only one the main record and all the related data I have in the navigation properties, so the info is more shorted.
Which is the advanteges and disadvantages of both methods to get related data in entity framework?
Thank so much.

Hello ComptonAlvaro,
>>I would like to know if the use of views on entity framework is a good idea to improve the performace or is better to use the include.
If your view would use a Join syntax to query master-child relationship tables, it actually is similar with the Include() method which actually results a duplicate records from master table, you could check this
link for detail description.
>>Which is the advanteges and disadvantages of both methods to get related data in entity framework?
One visible difference is that records from Views are not editable by default(if you want edit them, you could refer to this
blog).
In your case, my suggestion that you could use the lazying load which will load the matter table once and disable the trace if you only need to display data.
Regards.
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Can I purchase an IPhone 5 that is factory unlocked, so that I can insert my t-mobile sim card and use it on my service from the apple store?

Can I purchase an IPhone 5 that is factory unlocked, so that I can insert my t-mobile sim card and use it on my service from the apple store?

Not in the US, at the present time. Apple has not started selling officially unlocked iPhone 5's in the US, & has not announced when they will.

Differences between using Data Pump to back up database and using RMAN ?

what are differences between using Data Pump to back up database and using RMAN ? what is CONS and PROS ?
Thanks

Search for Database backup in
http://docs.oracle.com/cd/B28359_01/server.111/b28318/backrec.htm#i1007289
In short
RMAN -> Physical backup.(copies of physical database files)
Datapump -> Logical backup.(logical data such as tables,procedures)
Docs for RMAN--
http://docs.oracle.com/cd/B28359_01/backup.111/b28270/rcmcncpt.htm#
Docs for Datapump
http://docs.oracle.com/cd/B19306_01/server.102/b14215/dp_overview.htm
Edited by: Sunny kichloo on Jul 5, 2012 6:55 AM

Can I create a "stage" in Animate and use it in Muse to create a responsive site?

I want to use Muse to build my site and Animate for some elements. I need a responsive site. Muse does not do that but Animate does. That is crazy! How can I combine them? There has got to be a way. Someone smarter than I has figured it out I am sure, I am hoping they chime in.
Can I create the "stage" in Animate and use it in Muse?

You are probably right but I was looking for the ease in creating only one and letting it do the work.
Now that I think about it....my site will have video embedded and a link for Ustream. That won't work on a mobile device if it is part of a responsive design will it?
Oh, there is soooo much to all of this!
Newbie anxiety!
This is why I chose Muse and Animate, I am too new to code it on my own.

My mum is always using my iPad and I want to set mode if you like that she can log in as some one different and use apps she likes and I can use a diFferent log in and use different apps and stuff

My mum is always using my iPad and I want to set mode if you like that she can log in as some one different and use apps she likes and I can use a diFferent log in and use different apps and stuff

iOS 7 does not support multiple user accounts like you want.
If all the apps are different, you could set her up with her own page of apps, then just show her how to get to her apps page, or just buy her an iPad for herself.

Can i by iphone 5c from usa and use it in Belgium

can i by iphone 5c from usa and use it in Belgium???

Planning on coming to the US to do so? Factored in import duties? Aware that your warranty/support will only be valid in the US? Aware that the US phone most likely won't support LTE where you live?
Not a good idea, but the phone will work.

Can moving large sharepoint lists to database and using database table as an external list help performance?

Similar Messages

Maybe you are looking for