How to get performance extracting data from Project Management system
Kim
the following issue.
I have to extract data from a project management system using a supplied
SDK (and specific ODBC driver) (Backend is a sql-server but unfortunatly
the SDK builds some virtual tables and do some calculations so I can't
access the tables directly).
Getting data:
I'm getting the data using VB.NET SDK and specific ODBC driver (have to
use ADO), then I convert it to a dataset (to perform some inmemory
manipulations later).
When I supply (update) a project id to this SDK I get the possiblity to
access resources, activites, costs etc related to this specific
project(it build these tables virtually, by running a trace on
sql-server I've seen that it get's a lot of data and then performs som
internal manipulations to create the tables).
Manipulating and saving data 1.
So when I've got let's say three of these "virtual" tables data I have
to join them using their primary keys (the sdk doesn't let me join as
many tables as I want directly in a question). I've tried doing this in
a couple of ways.
(1. inserting data into temporay tables (and also persistent tables) in
sql-server and then joining them, 2. I've also tried using Helper
classes to join datasets directly). Both ways work but takes time. The
joined result from these tables is to be saved in sql-server in a kind
of history table. I've done this by looping through dataset and
inserting using the MS Data Application Block, and ADO.NET
Manipulating data 2
Then I have to summarize this data and save into another table. I've
done this by using the data in sql-server or by summarizing values of
the dataset. This have been done with VB.NET and ADO.NET
When client starts this little app that I wrote they can choose projects
to be included from within a list that means that the process above can
be repeated for a lot of projects (let's say 100).
So performance is slow, since it will not be done everyday it's not the
most critical point but it sure feels bad writing an app with such bad
performance.
Another thing id like some advice on is how to tackle the possibility
that the network goes done during one of these lengthy operations,
suggestions ?
Depending on size of projects the individual tables mentioned above can
have from 100 to 100 000 (activites) of posts so inserts and handling
the data is crucial for performance, all suggestions on improving
solution is apppreciated
-Thanks in advance
/Kim
*** Sent via Developersdex http://www.developersdex.com ***
Don't just participate in USENET...get rewarded for it!
pmp...@gmail.com
International Board of Project and Product Leadership (IBPL), in the series of IBPL National CXO Round Table Conferences (RTC), the upcoming RTC is going to be conducted at Hyderabad, on Saturday, December 15th2012 at ISB-Hyderabad.
This one day conference is designed for participation by key decision makers in the organizations who are involved in Project and Product Management activities across industries.It is a unique platform to interact with leaders and practitioners from industry, understand best practices, and participate in intensive and collaborative learning discussions.
For details please visit: http://www.ibpl.org/conference2012/
The event is will be attended by
Chief Guest:
Shri. Ponnala Lakshmaiah,Honorable State Minister for IT & Communication,Govt of AP
Guests of Honour:
Shri. BVR Mohan Reddy, CMD, Infotech Enterprises
Shri. Rajanna, Regional Head, TCS
Shri. JA Chowdary, Executive Chairman, Talent Sprint
Shri. Sateesh Andra, Investor
Shri. Sanjay Jaju, Secretary to Govt of AP, IT & C.
The event will also be attended by CXOs of various organizations.
The event is a power packed session where six panels (consisting of CXOs) will discuss on six critical industry topics like:
1. Strategy
2. Customer Expectations Management
3. Procurement& Vendor Management
4.Recruitment Management
5. Risk Management
6. Quality Management
In addition, the RTC would facilitate
• Interaction and networking between the state, leading industry practitioners, entrepreneurs, venture capitalists, academicians, specialists and other successful professionals.
• Great amount of networking with other senior leaders and to learn from Industry best practices.
• This is the place to be for executives, entrepreneurs, and companies looking to grow their knowledge to the next level.
Registrations:
IBPL being a not-for-profit society, also requests for a participation fee of INR 2999/- from the Participants so as to partially cover the cost of the event.
To register click on the following link: http://www.ibpl.org/index.php#join_form
About IBPL
Businesses world over are driven by same fundamental factors - Need to differentiate, innovate, and achieve super normal results. Project and Product Management are the two core disciplines that bring together these strategy and execution aspects and in a sense can be a microcosm of the larger organization in which they exist. Effectiveness with which Project and Product Management is executed in an organization can be the difference between whether an organization grows or fails.
International Board for Project and Product Leadership (IBPL), established in 2012 as a non-profit society, recognizes the importance of these two disciplines. The IBPL provides an international platform to industry leaders and practitioners from around the world in the area of Project and Product Management with a view to Enable cross industry collaboration and knowledge sharing at a global level.
Note:
All the participants in the event are eligible for 10 PDUs from Project Management Institute (PMI), USA
Event is supported by
The IT and ITES Industry Association of AP (Formerly HYSEA)
Follow us at:
http://www.facebook.com/pages/IBPL/382450991841740?ref=hl
http://www.linkedin.com/pub/ibpl/60/84a/a53
https://twitter.com/IBPLORG
https://plus.google.com/u/0/b/117740171141324280945/117740171141324280945/posts