A Proposed Algorithm for Determining the Suitable Number of Significant Digits of Force Transducer Calibration Constants


  • Riham S. hegazy National Institute for Standards, Egypt
  • Magdi Ibrahim National Institute for Standards, Egypt
  • Gouda. M. Mahmoud National Institute for Standards, Egypt




Significant digits, Force transducer, Rounding, uncertainty, calibration constants


Precision measurement is one of the important goals of measurement and calibration. Positive measures are designed to provide researches with the highest accuracy and precision levels. In force measurements, force measuring instrument manufacturers are striving to achieve the best force measurement resolution to accompany the high level of calibration measurement capabilities achieved by the primary deadweight machines. In the calibration of the force transducers, polynomial equations which correlate, the applied load on the transducer and its corresponding output signal in mV/V are deduced. These equations contain numerical constants A, B and C. This paper introduces a mechanism to determine the suitable number of significant digits for these constants. Error analysis procedure for the calibration polynomial equation is proposed. This proposed algorithm safeguards the most accurate and realistic method for rounding the calibration constants


Rodr.guez LC et al. Estimation of performance characteristics of an analytical method

using the data set of the calibration experiment. Analytical Letters. 1993;26(6):16

DOI: 10.1080/00032719308019900

Gu H et al. Selecting the correct weighting factors for linear and quadratic calibration

curves with least-squares regression algorithm in bioanalytical LC-MS/MS assays and

impacts of using incorrect weighting factors on curve stability, data quality, and assay

performance. Analytical Chemistry. 2014;86(18):8959-8966'

DOI: 10.1021/ac5018265

Hayashi Y et al. Detection limit estimated from slope of calibration curve: An application

to competitive ELISA. Analytical Sciences. 2005;21(2):167-169

DOI: 10.5772/intechopen.72932

Zhao Y et al. Reasons for calibration standard curve slope variation in LC-MS assays and

how to address it. Bioanalysis. 2014;6(11):1439-1443


Oliveira EC. Internal standard versus external standard calibration: An uncertainty Case

study of a liquid chromatography analysis. Quimica Nova. 2010;33(4):19


Tan A, Awaiye K. Use of internal standards in LC-MS bioanalysis. In: Li W, Zhang J, Tse

FLS, editors. Handbook of LC-MS Bioanalysis: Best Practices, Experimental Protocols,

and Regulations. John Wiley & Sons Inc.; 2013. pp. 217-227


Vicki Barwick Preparation of Calibration Curves A Guide to Best Practice " LGC/VAM/2003/032. Valid Analytical Measurement (VAM)

DOI: 10.13140/RG.2.2.36338.76488




How to Cite

hegazy, R. S., Ibrahim, M. ., & Mahmoud, G. M. . (2022). A Proposed Algorithm for Determining the Suitable Number of Significant Digits of Force Transducer Calibration Constants. Asian Journal of Applied Sciences, 10(5). https://doi.org/10.24203/ajas.v10i5.7072