Pool Serial Number Lookup

[Alice Palecek]

Iuse ADF to incrementally load data from 8000 tables into the data lake. Four ADF pipelines run simultaneously to load 2000 source tables each as CSV to the ADL. A lookup activity gets a max timestamp per view (each lookup is against a different view), then a copy activity loads all source data with timestamp greater than the lookup timestamp.

My feeling is that the serverless SQL pool cannot deal with the number of lookups - something is locking up, throttling, etc. But I would have thought it would scale automatically (and it only needs to deal with four simultaneous lookup queries). It could be the data lake throttling, but it feels less likely. I would like to run more than four pipelines simultaneously as the ingestion time is lengthy, but this increases the failure rate of the lookup.

Thanks for using Microsoft Q&A !!

I suggest you to please open a Azure Support ticket so that an engineer can look into this issue.

In case you have any limitation opening a support case please let me know and I will help you providing a free one time support ticket.

I had feedback from the serverless team who said that 0.15Mb file size is too small and will affect the performance of queries to the data lake. However, I disagreed. I think the serverless pool or data lake was locking up (or something) due to too many concurrent/consecutive queries per unit time (?). Queries that take seconds when run individually, take minutes and fail when run in a batch.

My average file size was 0.15Mb and most of the files were empty. If you ignore the empty files, then the average is probably more like 1.2Mb per file (though this is still much smaller than the 200Mb advised by the serverless team).

Ultimately, the problem was possibly due to querying empty files in the data lake through the serverless pool -- querying an empty recordset gives 0 as the latest timestamp, but perhaps this was somehow the cause of the bottleneck.

Also, when performing lookups, I originally had a stored procedure that was querying a 'view' in the serverless SQL pool to return the latest timestamp -- but I changed the procedure to query the datalake directly via OPENROWSET instead of through the view, which improved performance.

* Please note there is an error in the current rule language stating renewal is due on the licensee's birthday. This was an inadvertent change that doesn't work since this isn't an individual license, so the department will continue to process renewals every year on the date of issuance as the previous rule directed. This error will be corrected in future rule making.

Applicants must list all states where they do or did hold credentials. This list must also include when the applicant has applied for a credential, even if a credential was not granted. The jurisdiction where the applicant is or was credentialed must complete and submit the verification form (PDF). The jurisdiction must send the completed form directly to the department.

Each applicant must answer the personal data questions. If there is a positive answer to the professional liability claims history question, the applicant must send an explanation of the nature of the case, data and summary of care given, copies of the original complaint, and the settlement or final disposition. If a case is pending, applicant must indicate status.

We finish final review for approval after a credentialing specialist verifies that the application is fully complete, and complies with requirements in chapter 18.52C RCW and chapter 246-845 WAC. We complete background checks and make sure applicants have submitted required fees. Credentialing supervisors and lead workers have the authority to approve routine applications. The disciplining authority may conduct further review if the credentialing supervisor can't verify the applicant meets all requirements. We'll formally notify applicants of a denial. Those applicants may request a hearing to appeal the decision.

Before expiration, nursing pool registrations must be renewed every year on the date of original issuance. They're required to submit the appropriate fee, renewal card and background check compliance affidavit.

In order to serve you better, we must have your correct mailing address in our system. This is especially important because we mail your courtesy renewal notice and updated credential to the address on file. The U.S. Postal Service does not forward Department of Health mail. If your contact information is not current in our system, please complete and submit the contact information change form. If you have questions, feel free to contact our staff.

Registration with the Department of Health will ensure that your Nursing Pool is registered. You may also contact the Department of Licensing to get a business license, the Washington State Patrol to perform criminal background checks and the Internal Revenue Service to get a tax I.D. number.

Vehicle Information can now be viewed within the newly launched Fleet Management app. Please email completed Vehicle Safety Inspection Forms for inspections completed by an outside vendor to moto...@facilitiesservices.ufl.edu.

All University of Florida departments registering a new vehicle for use at UF must complete and submit a Vehicle Intake Form. Motor Pool services, including the required pre-delivery inspection and assignment of a fuel fob cannot be provided if the vehicle intake form, supporting documentation, and funding for Motor Pool services have not been received from the customer. Back-up documentation (Certificate of Origin, Invoice, etc.) should be provided to Motor Pool upon delivery of the vehicle to complete the set-up in our system.

Motor Pool personnel are authorized to remove any vehicle from service that does not pass its safety inspection. And as the annual inspection is mandatory, the University Police Department will leave a Notice of Violation of University Policy on vehicles without current inspection decals. Vehicles receiving a Notice of Violation must be inspected within 15 days of the notice or the vehicle may be impounded until a safety inspection is completed.

The Parts Department at the Motor Pool stocks most parts needed for emergencies, including batteries, tires, filters, bulbs, fuses, wiper blades, and other items to keep your vehicle on the road and functioning safely.

All work orders for service are written by the Motor Pool staff at our main service desk. Customers must provide the vehicle number, current mileage, contact name, email address and phone number, and an explanation of the reason the vehicle is being brought to the shop. Please be prepared to leave the vehicle with us, unless prior arrangements have been made for service while you wait.

3a8082e126