Introduction
With the increase in manpower cost and the cost of maintaining records on paper, it is pushing more and more laboratories to adopt Calibration LIMS software (other than Excel) so that they can get the benefit of IT revolution that has already started spectrum wide in other industry sectors. For these laboratories the benefits are many such as following:
- Less reliance on paper, thus reducing paper based operations and reduced cost of preserving paper records
- Increase in efficiency
- Reduction in clerical mistakes that creeps into the system during transfer of data from paper based forms to worksheets (in Excel)
- Strengthening process of control and governance
While earlier, cost of software was prohibitively high but with the advent of Cloud computing now a days, laboratories can adopt a cloud hosted software without taking any cost of IT infrastructure other than availability of Internet thus reducing overall cost of adoption of Calibration Lab Management Software.
SmartCalibration is one such product that is available on internet hosted and serviced by SCC IT solution pvt. Ltd. SCC takes prides in the fact that it’s aim is to propagate adoption of Software in small and very small business organization.
SmartCalibration: Calibration Lab Management Software
Functional coverage of Laboratory Operation by SmartCalibration Lab software
For the sake of this paper, summarizing SmartCalibration features coverage of any laboratory operations, we are assuming that all the features of SmartCalibration are used by the laboratories (although each of the modules can be switched off such as quotation, invoicing).
- Quotation
- Customer Order logging
- Creating Project/Assignment from the customer order
- Logging DUC/UUC details against each of the job
- Publishing Service request form/order and Job card
- Logging Calibration Results
- Calculations of derived data including Uncertainty, and other environment correction
- Publishing of Observation form and Certificate document
- Invoicing the customer
- Maintaining data related to standard references and its traceability.
- Defining pre-defined uncertainty
Access to each of the modules could be defined for each user based on the user group that he/she may belong to or on exception by laboratory senior manager. Each of the document or module have two level of hierarchy, one who is drafting the data and other who approves the data and allows transaction or document produced by it to be sent to the client/customer.
Language and Platforms
Software Language: PHP
Web Server: Apache
Database Server : Mysql
Applicable Extent of Validation Process
As per guidelines of the EUROLAB paper, all the software system has been categories into five type, depending on the category, process of validation could be designed accordingly.
As per the paper, there are six different steps in validation process which are as follows
Validation Type | Validation Step | Relevance to SmartCalibration |
V0 | Manufacturer Documentation | Not Applicable |
V1 | Requirement Specification | Relevant, Functional Specification of SmartCalibration would be handed over to the laboratory |
V2 | Design and Implementation (coding) | To be maintained by SCC as code developer |
V3 | Inspection and structural testing | White Box testing conducted by software provider |
V4 | Installation | Provided by software provider |
V6 | Acceptance testing (black box testing) | Laboratory must take a confidence test even when it is COTS version however if customization and configuration changes are made, then it is essential first step |
- Table of Validation Types are taken from EUROLAB document (please see references section)
SmartCalibration is a Commercial ‘Off the shelf’ Software, thus laboratories wishing to use the software as it is with the supplied formats and templates, do not need to validate it as per 5.4.7.2, which states “Commercialoff-the-shelfsoftware (e.g. wordprocessing, database and statistical programmes) in general use within their designed application range may be considered to be sufficiently validated ,however, laboratory software configuration/modifications should be validated as per 5.4.7.2a)“, thus it is essential that all changes in calibration results ,capturing formats, printing templates etc must be validated for input/output.
Breadth and depth of Validation Steps
Since SmartCalibration is COTS application, Laboratories must carry out following steps (correlating to T1 and T2 of EUROLAB document)
T1: Typical Input data set and operations (navigation thru the application) as guided by the user manual or training material, check for obvious errors and log these in the test pack.
T1b: Test of data transfer by direct observation, eg from database to Observation(ODT document) template
T2: Test of SW functionality, with respect to integrity, traceability, access rights, safety etc.
T2a: Validation of Calibration data by way of comparison method, we recommend that at least 5 separate data sets must be selected from existing paper based or currently used application data for each type of instrument using each of the standard reference.
- Enter Sample input data from existing calibration results (sourced from raw data sheet)
- Verify the calculations with Worksheet (Excel calculations) or existing calculation supporting tool (Internet based free to use website)
- Compare the output published in ODT document by Smart Calibration with Certificate corresponding to source data.
Output : Evidences thus collected, screen shots and documents generated by application and a copy of existing source data must be filed diligently with uniquely test step identification number.
Clause wise analysis of SmartCalibration features that helps in conformity
ISO17025.4.1.5c: have policies and procedures to ensure the protection of its customers’ confidential information and proprietary rights, including procedures for protecting the electronic storage and transmission of results.
SmartCalibration is protected by Login and Password that is further protected with random string Captcha to prevent robots attacking. Laboratory should draft policy to ensure that each user keeps password difficult to guess and accesses to the users are assigned on role basis.
ISO17025.4.2.1: The laboratory shall establish, implement and maintain a management system appropriate to the scope of its activities.
Software can be part of the management system, Laboratories have to modify their standard operating procedures to make it part of the process.
ISO17025.4.3.1: The laboratory shall establish and maintain procedures to control all documents that form part of its management system (internally generated or from external sources), such as regulations, standards, other normative documents, test and/or calibration methods, as well as drawings, software, specifications, instructions and manuals.
Calibration Methods, and standard points of calibration could be specified in the format for capturing calibration results within the application. The access to these modules are part of the calibration setup functionality thus could be restricted only to senior and authorized laboratory resources.
ISO17025.4.3.1: Management system documents generated by the laboratory shall be uniquely identified. Such identification shall include the date of issue and/or revision identification, page numbering, the total number of pages or a mark to signify the end of the document, and the issuing AUTHORITY (ies).
All the documents generated by the SmartCalibration modules are uniquely identified either by its entity for example quotation reference, job card number, SRF number or another unique sequence number accordingly. Certificate number sequence is separately maintained and its uniqueness is ensured by software as well as by database constraints. Laboratory can customize certificate number sequence pattern that would be generated for each of the certificate.
Everytime a calibration result format is changed to include a new column, change existing details or formula functions, a new version of the format is created that would be effective from the date of change.
ISO17025.4.3.4.Procedures shall be established to describe how changes in documents maintained in computerized systems are made and controlled.
This applies only to the documents that are published by the SmartApplication, File name generated by the application could be suffixed or prefixed with time stamp thus creating a different version every time the document is regenerated. By default, versioning is switched off thus it would overwrite the document that was generated earlier.
ISO17025.4.4.1 The laboratory shall establish and maintain procedures for the review of requests, tenders and contracts. The policies and procedures for these reviews leading to a contract for testing and/or calibration shall ensure that:
This is applicable only when laboratories wish to use quotation, and invoicing modules of Smart Calibration. Customer order registration is essentially part of calibration module thus is mandatory for all the laboratories that are wishing to use SmartCalibration module.
ISO17025.4.13.1.2. All records shall be legible and shall be stored and retained in such a way that they are readily retrievable in facilities that provide a suitable environment to prevent damage or deterioration and to prevent loss. Retention times of records shall be established.
All the modules and screens are not more than three clicks apart if using mouse for navigation thru SmartCalibration product interface. In addition to this, users can create bookmarks for the modules that they frequently visit.
SmartCalibration Module could be configured to purge or archives data related to customer and services provided after a laboratory specified retention period.
ISO17025.4.13.1.4 The laboratory shall have procedures to protect and back-up records stored electronically and to prevent unauthorized access to or amendment of these records.
SmartCalibration is open application and cloud hosted, SCC IT Solution its administrator ensure backup of database is taken on every day, every week and every month on recyclable basis (ie, today back up will overwrite yesterday backup). All the backups are stored away from the laboratory thus it would be save even in case of fire or any disaster at or around laboratory. Backups are stored at Hosted Server space contracted by SCC, while monthly backup is preserved in local server of SCC India office.
As the data is stored in 3GL database and in 3rd normal form, it is difficult for laboratory user to change the data by itself. The data in the database layer could be modified by people who not only understand how database works as a technology but also understand how database for SmartCalibration is organized.
ISO17025.4.13.2.1 The laboratory shall retain records of original observations, derived data and sufficient information to establish an audit trail, calibration records, staff records and a copy of each test report or calibration certificate issued, for a defined period. The records for each test or calibration shall contain sufficient information to facilitate, if possible, identification of factors affecting the uncertainty and to enable the test or calibration to be repeated under conditions as close as possible to the original. The records shall include the identity of personnel responsible for the sampling, performance of each test and/or calibration and checking of results
Smart Calibration preserve and save all raw data and calculated data in the database which could all be printed also in a report or document.
ISO17025.4.13.2.2 Observations, data and calculations shall be recorded at the time they are made and shall be identifiable to the specific task.
As Smart Calibration is Web application, engineers can log the result even when they are on the site using laptop or tablet devices if these are connected to the Web. Observation forms can be accessed through the job module only and is uniquely to each job number. Pl see snapshot of application
ISO17025.5.4.7.1 Calculations and data transfers shall be subject to appropriate checks in a systematic manner.
Since lot of calculations are dependent on data setup by the laboratories on application (such as defining uncertainty factors as per the process and of standards), formulas and functions that are used in data formats thus it is essential that calculations to be validated by the laboratories before putting it to regular use. Please refer to Observation Form published by SmartCalibration Annexure-3 Observation Form
SmartCalibration providing review and approval process within the application.
- Laboratory Administrator can assign Authorised Approver and Calibration engineer on each of the job. Calibration Engineer will have access to calibration result capturing module and can send captured result for review by clicking on “Send for Review” button, this triggers a information mail to the assigned approver who should login onto the application and approve the results after his/her review.
- User can publish certificate document only after authorized signatory approve it formally on the application by clicking on Approve Button with his review comments or statement wrt calibration results.
computer software developed by the user is documented in sufficient detail and is suitably validated as being adequate for use;
ISO17025.5.4.7.2a, 5.5.2: computer software developed by the user is documented in sufficient detail and is suitably validated as being adequate for use;
SmartCalibration training material and user guide are good enough to guide technical or commercial team to make best use of features. In addition to the documents, SCC also provides user support to the customer team.
Calculation should be validated by the user laboratories the best way to validate the calculation is by cross verifying the results and calculations with the existing tools or applications (Excel based calculations vs SmartCalibration)
ISO17025.5.4.7.2b procedures are established and implemented for protecting the data; such procedures shall include, but not be limited to, integrity and confidentiality of data entry or collection, data storage, data transmission and data processing;
Responsibility lies with the laboratory; application allows laboratory organization to define user accesses as per roles and responsibilities. Other responsibilities that should be mentioned in the procedure manuals includes followings
– To ensure user passwords are complex enough for any guess making.
– To ensure, user is disabled promptly in case user leaves the organization
– To ensure, access to the application and jobs assigned stays only with the genuine resource working on it (for eg. Calibration engineer should not have access to customer module)
– Person on Sales and Engineer roles should be separate and should not have access
ISO17025.5.4.7.2c. computers and automated equipment are maintained to ensure proper functioning and are provided with the environmental and operating conditions necessary to maintain the integrity of test and calibration data.
SmartCalibration hosted database and web server are maintained in environment meant for effective and efficient working environment (temperature controlled environment)
ISO17025.5.5.5. Records shall be maintained of each item of equipment and its software significant to the tests and/or calibrations performed.
SmartCalibration allows each job to be uniquely associated with a (unit under calibration) UUC/(Device under Calibration) DUC. UUC/DUC received by the laboratory is uniquely identified with its model+make+serial number/ID number.
Smartcalibration also enables users to see all previous calibration data/certificate and observation results on screens or the documents relating to the previous assignment.
ISO17025.5.5.12 Test and calibration equipment, including both hardware and software, shall be safeguarded from adjustments which would invalidate the test and/or calibration results.
All the upgrades/enhancement, fixes to the deployed application should be fairly assessed and validated before accepting into practice. SCC is maintaining test site for the users to test the enhancement before accepting and acknowledging deploying new change or fixing. Acceptance testing should be done after the deployment by the laboratory.
ISO17025.5.10.2 Each test report or calibration certificate shall include at least following, Title, Name and address of the laboratory and location where the calibration was carried out, Unique identification of certificate number, Identification of method, Name and address of customer, Date of receipt of DUC, validity, calibration results, date of calibration, Calibration results where appropriate with unit of measurement, Name, function and signature or identification of person authorizing the certificate, a statement to the effect that the results relate only to the items tested or calibrated, Page number and total pages in certificate, Note 2, Reference to environment conditions, A traceability of references used the uncertainty of measurement
ISO17025.5.10.4 Calibration certificates
ISO17025.5.10.4.1 In addition to the requirements listed in 5.10.2, calibration certificates shall include the following, where necessary for the interpretation of calibration results:
a) the conditions (e.g. environmental) under which the calibrations were made that have an influence on the measurement results;
b) the uncertainty of measurement and/or a statement of compliance with an identified metro-logical
specification or clauses thereof;
c) evidence that the measurements are traceable (see Note 2 in 5.6.2.1.1).
Calibration certificate includes all of the minimum information that has been mentioned in 5.10.2, Please refer to sample certificate in Annexure-4 Certificate
ISO17025.5.10.4.2 The calibration certificate shall relate only to quantities and the results of functional tests. If a statement of compliance with a specification is made, this shall identify which clauses of the specification are met or not met.
SmartCalibration provides facility to make a conclusion statement to the approver (authorized signatory) that could get published in the certificate template. The field can be left blank if not asked by the customer.
ISO17025.5.10.4.4 Calibration certificate (or calibration label) shall not contain any recommendation on the calibration interval except where this has been agreed with the customer. This requirement may besuperseded by legal regulations.
SmartCalibration allows laboratory to record validity period in the Job card which is also used for automatic calculation of next calibration date however it is laboratory discretion whether to print it in the certificate document or not.
ISO17025.5.10.7 Electronic transmission of results In the case of transmission of test or calibration results by telephone, telex, facsimile or other electronic or electromagnetic means, the requirements of this International Standard shall be met (see also ISO17025.5.4.7).
While SmartCalibration allows email to be sent thru application for quotation, srf and invoice as these are published in PDF format but it does not offer to email certificate or observation document as these are published in ODT (Open Document Text), we expect laboratory to convert these documents into PDF using MS Word or any ODT document editor available (such as Libre Office) and mail the scanned and signed copy or converted read only version.
Annexure-5 Assessment worksheet – SmartCalibration features in the context as ISO17025 compliance supporting tool
Clause # | Clause Narrative as per ISO | Relevance to Software |
4.1.5.c | have policies and procedures to ensure the protection of its customers’ confidential information and proprietary rights, including procedures for protecting the electronic storage and transmission of results; | Customer Information protection and protection of electronic storage and transmission of results |
4.2.1 | The laboratory shall establish, implement and maintain a management system appropriate to the scope of its activities. | Software can be part of the management system |
4.3.1 | The laboratory shall establish and maintain procedures to control all documents that form part of its management system (internally generated or from external sources), such as regulations, standards, other normative documents, test and/or calibration methods, as well as drawings, software, specifications, instructions and manuals. | Test and or Calibration Methods, software specifications |
4.3.2.3 | Management system documents generated by the laboratory shall be uniquely identified. Such identification shall include the date of issue and/or revision identification, page numbering, the total number of pages or a mark to signify the end of the document, and the issuing authority(ies). | Documents that are published by the software such as Job Card, SRF Sheet, observation form and certificate |
4.3.3.4 | Procedures shall be established to describe how changes in documents maintained in computerized systems are made and controlled. | Versioning of documents published by the software |
4.4.1 | The laboratory shall establish and maintain procedures for the review of requests, tenders andcontracts. The policies and procedures for these reviews leading to a contract for testing and/or calibration shall ensure that: | In case, software is used for quotation and order booking |
4.13.1.2,4.13.1.3 | All records shall be legible and shall be stored and retained in such a way that they are readily retrievable in facilities that provide a suitable environment to prevent damage or deterioration and to prevent loss. Retention times of records shall be established. | Data retention policy and access to documents and data |
4.13.1.4 | The laboratory shall have procedures to protect and back-up records stored electronically and to prevent unauthorized access to or amendment of these records. | Relevant Back and restore strategy |
4.13.2.1 | The laboratory shall retain records of original observations, derived data and sufficient information to establish an audit trail, calibration records, staff records and a copy of each test report or calibration certificate issued, for a defined period. The records for each test or calibration shall contain sufficientinformation to facilitate, if possible, identification of factors affecting the uncertainty and to enable the test orcalibration to be repeated under conditions as close as possible to the original. The records shall include the
identity of personnel responsible for the sampling, performance of each test and/or calibration and checking of results |
Software should preserve all raw data as well as derived data from various formulas |
4.13.2.2 | Observations, data and calculations shall be recorded at the time they are made and shall be Identifiable to the specific task. | Observation form need to be associated with job card |
5.4.7.1 | Calculations and data transfers shall be subject to appropriate checks in a systematic manner. | Automated calculations should be verified during validation |
5.4.7.2a5.5.2 | computer software developed by the user is documented in sufficient detail and is suitably validated as being adequate for use; | Proper record of acceptance testing should be maintained (such as Excel vs SmartCalibration) |
5.4.7.2b | procedures are established and implemented for protecting the data; such procedures shall include, but not be limited to, integrity and confidentiality of data entry or collection, data storage, data transmission and data processing; | Data should be access controlled, a action log to be maintained for all user action on technical data |
5.4.7.2c | computers and automated equipment are maintained to ensure proper functioning and are provided with the environmental and operating conditions necessary to maintain the integrity of test and calibration data. | Servers are maintained in adequate to use environment condition |
5.5.5 | Records shall be maintained of each item of equipment and its software significant to the tests and/orCalibrations performed. | UUC or DUC information should be uniquely identified in the software |
5.5.12 | Test and calibration equipment, including both hardware and software, shall be safeguarded fromadjustments which would invalidate the test and/or calibration results. | All the changes to the software should be configuration controlled and revalidated before accepting it into practice |
5.10.2 | Each test report or calibration certificate shall include at least,
|
Published calibration certificates can be customized to actually look like the one that are being used by the laboratory. Software has all this information on the database and all the data can be published in Laboratory provided format or layout. |
Author Disclaimer and Statuary Statement
SCC IT have tried to put facts and interpretations derived from various published information over the internet, it was our best attempt to put things in correct perspective thus any mistake or incorrect statement is inadvertent, however we will be happy to correct any anomaly or inconsistency if notified by email or through query forms after taking view from our consultants.
SCC IT solution is not making statement that laboratory adopting the SmartCalibration product will be compliant to ISO17025 regulation, as we believe that no software or application can make any laboratory compliant to ISO17025 automatically, or alternatively, No laboratory shall be certified conforming to ISO17025 by just adopting a software (that has all or some features that support conformance) in its working practices.
The above statement is fair as well, since it depends on laboratory how they use the software as a tool or application in its day to day processes and question. SmartCalibration is modular application that has flexibility to switch off modules not required by the laboratory, even within modules, features of modules can be switched off or made active based on lab requirements.
Appendix 6: Terms and Dictionary
Terms and Abbreviations | Explaination or description |
DUC | Device Under Calibration (device received by the laboratory for calibration) |
UUC | Unit under Calibration (instrument received by the laboratory for calibration) |
NABL | Accreditation Board for Testing and Calibration |
ISO | International Standards Organisation, responsible for drafting standards and guidelines |
SRF | Service Request Form (generated by calibration labs after receiving instruments for calibration, it contains list of all work in scope of calibration from the customer) |
Job Card | Lab Administrator entrust each of the job received in the scope of work to Lab engineers |
IT | an abbreviation of Information Technology, technology commonly known and linked with computer, networking and software |
PHP | Hypertext Preprocessor |
Apache | is the world’s most widely used web server software. |
MySQL | A relational database management system most commonly used open source database |
SW | Software |
ODT | Open Document text |
Portable Document Format | |
3GL | 3rd Generation programming language normally used for scripting language used within RDBMS |
WEB | An acronym used to say Internet |
EUROLAB | European federation of national associations of Measurement, Testing and Analytical laboratories |
COTS | Commercial Off-the-shelf software |
MOTS | Modified Off-the-Shelf software |
Appendix 7:References
Guidance for the Management of Computers – eurolab
Complying with ISO 17025 A Practical Guidebook – UNIDO
ISO/IEC 17025:2005 – General requirements for the competence of testing and calibration laboratories
Download this paper in PDF format from clicking here SmartCalibration for ISO17025 compliant laboratories