|Year : 2011 | Volume
| Issue : 4 | Page : 245-249
Safety and efficacy of nicotinamide in the management of hyperphosphatemia in patients on hemodialysis
J Vasantha1, P Soundararajan2, N Vanitharani1, G Kannan1, P Thennarasu1, G Neenu1, C Umamaheswara Reddy3
1 Department of Pharmacy Practice, Faculty of Pharmacy, Sri Ramachandra Medical College, Chennai, India
2 Department of Nephrology, Sri Ramachandra Medical College, Chennai, India
3 Department of Pharmacology, Faculty of Pharmacy, Sri Ramachandra University, Porur, Chennai, India
|Date of Web Publication||29-Sep-2011|
Department of Pharmacy Practice, Sri Ramachandra University, Porur, Chennai - 600 116
Source of Support: None, Conflict of Interest: None
Hyperphosphatemia is an important modifiable risk factor for death and cardiovascular events in patients on hemodialysis (HD). As nicotinamide has been shown as an inhibitor of sodium-dependent phosphate co-transport in rat renal tubule and small intestine, we examined whether nicotinamide reduces hyperphosphatemia in patients undergoing HD. The study was conducted in 30 end-stage renal disease (ESRD) patients [20 (66.7%) males and 10 (33.3%) females; mean age 54 ± 14.9 years] undergoing twice/thrice weekly HD for more than 3 months. Patients on other phosphate binders were given a 2-week wash-out period. Nicotinamide 250 mg capsules were given twice daily for 25 patients with serum phosphorus greater than 5 mg/dL and thrice daily for 5 patients with serum phosphorus greater than 8 mg/dL immediately after food for 8 weeks. Serum phosphate and calcium levels were estimated every month prior to HD session, and complete blood count, blood sugar, renal profile, liver function tests were estimated at beginning and end of the study. Patients were regularly monitored for side effects. There were significant decreases in the serum phosphate (6.85 ± 1.35 mg/dL at the baseline to 5.74 ± 1.18 mg/dL at the 4 th week and to 4.54 ± 0.86 mg/dL at the 8 th week), the serum calcium-phosphorus product (57.8 ± 12.21 at the baseline to 48.3 ± 10.71 on 4 th week and to 38.201 ± 8.21 at the 8 th week), and alkaline phosphatase levels (130.23 ± 50.13 IU/L at the baseline to 116.40 ± 48.27 IU/L after 8 weeks) on treatment with nicotinamide (P < 0.001). Other parameters remained unchanged. Watery stools reported by seven patients resolved during the course of the therapy. Nicotinamide is safe, cheap and effective in controlling serum phosphorus, Ca × P product and alkaline phosphatase levels in patients on maintenance HD.
Keywords: Hemodialysis, hyperphosphatemia, nicotinamide, phosphate, renal disease
|How to cite this article:|
Vasantha J, Soundararajan P, Vanitharani N, Kannan G, Thennarasu P, Neenu G, Reddy C U. Safety and efficacy of nicotinamide in the management of hyperphosphatemia in patients on hemodialysis. Indian J Nephrol 2011;21:245-9
|How to cite this URL:|
Vasantha J, Soundararajan P, Vanitharani N, Kannan G, Thennarasu P, Neenu G, Reddy C U. Safety and efficacy of nicotinamide in the management of hyperphosphatemia in patients on hemodialysis. Indian J Nephrol [serial online] 2011 [cited 2022 May 23];21:245-9. Available from: https://www.indianjnephrol.org/text.asp?2011/21/4/245/83735
| Introduction|| |
Hyperphosphatemia is invariable amongst patients with end-stage renal disease (ESRD), and is an important and modifiable risk factor. Patients with serum phosphorus greater than 6.5 mg/dL have a 27% higher mortality risk than those with phosphorus levels between 2.4 and 6.5 mg/dL.  The long-term consequences of inadequate phosphate control include secondary hyperparathyroidism, metabolic bone disease, calcific uremic arteriolopathy, and cardiovascular calcification. Progressive increases in arterial calcification are associated with greater rates of mortality. 
Adjusted mortality increases by 20-40% with extreme increases in inorganic phosphorus (above 4.2 mg/dL) and similar effects have been reported for calcium × phosphorus (Ca × P) product (>45.9). , An increased Ca × P product is associated with calcium-phosphate precipitations in blood vessels, myocardium, and heart valves. 
Inorganic phosphorus has been a categorized as a true uremic toxin. ,, Guidelines recommend normalization of phosphate levels in ESRD patients which is rarely achieved by extracorporeal therapy alone. ,
The treatment for hyperphosphataemia in ESRD has been based on the use of oral phosphate binders taken at mealtimes. Calcium-based agents have traditionally been used as first-line therapy since they correct hypocalcemia in addition to reducing serum phosphate levels and are inexpensive. However, these agents may not be suitable for all patients because of dose-limiting hypercalcaemia. 
Aluminum hydroxide administration can lead to anaemia, osteomalacia, myopathy, and dementia and magnesium based agents causes gastrointestinal intolerance. 
Sevelamer was the first non-calcium, aluminum-free agent to be approved for use. Sevelamer may aggravate metabolic acidosis, gastrointestinal disturbances and also expensive; so is lanthanum. ,,,,
Nicotinamide reduces intestinal phosphate absorption by inhibiting the gastrointestinal sodium/phosphate 2b transporter (Na/Pi 2b). ,,,,, Unlike niacin, it does not activate G-protein receptors specific for niacin and does not cause flushing. ,,, However, it has dose-related gastrointestinal side effects, including diarrhea and cramping. Heartburn is a rare side effect of nicotinamide.  The majority of reported side effects have been reversible after discontinuation of the drug. ,
For many years it has been thought that niacin raises high density lipoprotein (HDL) cholesterol and reduces triglyceride levels. Recent studies of nicotinamide therapy in patients undergoing dialysis have proved that it also increases HDL cholesterol. ,,,,,
Keeping in view the need of inexpensive phosphate control, nicotinamide was studied to find out the efficacy and safety in reducing serum phosphorus in HD patients.
| Materials and Methods|| |
A prospective study was conducted in the dialysis unit of a 1700- bedded tertiary care teaching hospital, with the approval of the institutional ethics committee. The study population consisted of 30 ESRD patients aged above 18 years, undergoing twice/thrice weekly HD for over 3 months. Patients who were taking a stable dosage of phosphorus binders (calcium carbonate/calcium gluconate) for 1 month before the study and whose serum phosphorus levels were greater than 5 mg/dL after the washout period were included in the study, after obtaining their consent. Pregnant women, patients who had a history of liver disease and peptic ulcer disease and patients who were scheduled for any surgical procedures were excluded.
Study patients were made to discontinue the phosphate binders and given a 2-week washout period before administration of niacinamide. Patients whose serum phosphorus was greater than 5 mg/dL after the 2-week washout period were started on niacinamide 250 mg capsules twice daily immediately after food for 8 weeks. Patients whose serum phosphorus was greater than 8 mg/dL after the 2-week washout period were given niacinamide 250 mg capsules thrice daily immediately after food for 8 weeks, and after 8 weeks, niacinamide therapy was stopped.
Nutritional counseling was given to all HD patients to limit the intake of diet rich in phosphorous, which included- moderate protein intake (about 1.0 g/kg/day), increasing the proportion of plant-derived foods as sources of protein since their phosphorus content is less absorbed, and restricting consumption of highly processed fast and convenience foods.
Biochemical parameters were analyzed by standard clinical laboratory measures. Serum phosphorus and calcium levels where estimated once every month prior to HD session and other parameters like complete blood count, blood sugar, renal profile, and liver function tests were estimated at beginning and end of the study. Patients were regularly monitored for side effects like gastrointestinal discomfort during the study period. Comparison of serum phosphate levels at the baseline, at the end of 4 weeks of therapy and after completion of therapy with nicotinamide (at the end of 8 weeks) was done using paired t-tests. A P-value of <0.05 was considered significant.
| Results|| |
A total of 30 patients (23 patients on twice weekly and 7 on thrice weekly dialysis) were included in the study. The study population consisted of 20 (66.7%) males and 10 (33.3%) females, aged above 20 years, with a mean age of 54±14.9 years. Majority of the patients were in the age range of 41- 60 years (13 patients).The most common co-morbidity was hypertension in 20 patients (66.7%), followed by diabetes in 8 (26.7%). Sixteen (53.3%) patients were taking calcium carbonate 500 mg thrice daily and 14 (46.7%) patients were taking calcium acetate 667 mg thrice daily as phosphate binders before the washout period of 2 weeks [Table 1].
Twenty-five patients (10 women and 15 men) with serum phosphorus >5 mg/dL were given niacinamide 250 mg twice daily and 5 patients (1 woman and 4 men) with serum phosphorus >8 mg/dL were given nicotinamide 250 mg thrice daily immediately after meals for 8weeks. There was a significant reduction (P < 0.001) in the mean serum phosphorus levels after 4 weeks of drug treatment and after 8 weeks of drug treatment when compared to the serum phosphate levels at the baseline. Serum phosphate levels decreased from 6.85 ± 1.35 mg/dL at the baseline to 5.74 ± 1.18 mg/dL at the 4 th week and then to 4.54 ± .86 mg/ dL at the 8 th week of nicotinamide therapy [Table 2].
|Table 2: Mean serum phosphorus after 4 and 8 weeks after niacinamide treatment|
Click here to view
The mean serum calcium×phosphorus product decreased from 57.8 ± 12.21 at the baseline to 48.3 ± 10.71 on 4 th week and 38.20 ± 8.21 on 8 th week of nicotinamide treatment [Table 3].
|Table 3: Serum Ca × P after 4 and 8 weeks of after niacinamide treatment|
Click here to view
[Table 4] shows the laboratory results of the patients at the baseline and eight weeks after therapy. Serum calcium almost remained unchanged during the 8 weeks of nicotinamide treatment showing the levels of 8.42 ± 0.46 mmol/L before and 8.423 ± 0.52 mmol/L after treatment. There was no change in serum calcium level during the study period. BUN, creatinine, and uric acid levels showed no significant change during the study period. But there was a significant reduction in alkaline phosphatase levels during nicotinamide treatment period, from 130.23 ± 50.13 IU/L at the baseline to 116.40 ± 48.27 IU/L after 8weeks of treatment.
|Table 4: Biochemical parameters before and after the niacinamide treatment|
Click here to view
There were no changes in platelet count, liver function, blood sugar levels, BUN, uric acid, creatinine, serum protein and albumin levels. Watery stools were reported by seven patients when the drug was introduced, which later resolved during the course of the therapy.
| Discussion|| |
Niacin, first isolated from rice bran in 1911 and more commonly known as vitamin B3, is a water soluble vitamin with a recommended daily allowance of 0.3 mg/ kg/day. It was later recognized to have two distinct but chemically related components, nicotinamide and nicotinic acid. Niacin deficiency causes pellagra in man.
Nicotinamide was first isolated from the horse erythrocytes in 1935, and is a component of NAD, a coenzyme involved in many cellular oxidative reduction reactions. NAD is proposed to be an intracellular inhibitor of sodium-dependent phosphate transport. Nicotinamide has been shown in rats to increase the renal cortical NAD concentration, to inhibit phosphate uptake by brush border membrane vesicles of the renal proximal tubules in the rat kidney, and to increase phosphate excretion in thyroparathyroidectomized rats. ,
Nicotinamide is now known to inhibit sodium/phosphorous transport in both renal and intestinal brush borders, stimulating interest in its use for phosphorus reduction among patients with CKD. In this connection, several studies have been performed and have shown that nicotinamide does decrease phosphorus levels in dialysis patients. ,,,
The present study has yielded positive results with oral nicotinamide in reducing serum phosphorus levels substantially. A statistically significant decrease of mean serum phosphorus was found at the 4 th and at the end of 8 th week of nicotinamide therapy.
We maintained the doses at the same level for a period of 8 weeks to see whether the serum phosphorus levels decreased irrespective of the increase in doses. A significant decrease in mean phosphorus levels was observed in 4 weeks and further decrease was noted at the end of 8 weeks. This is quite distinct from other studies where the doses were increased every 2 weeks during the study.
In this study, no other phosphate binders were co-administered along with nicotinamide to reduce the phosphate levels, which correlated with the findings of Takahashi  and Sampathkumar,  who demonstrated that nicotinamide lowers serum phosphorus levels in maintenance HD patients even when traditional binding agents are withheld. But this is not in concordance with the study conducted by Cheng,  who concluded that nicotinamide reduces serum phosphorus when co-administered with other phosphate binders.
In the present study, a statistically significant decrease in mean serum Ca × P product was observed in 4 weeks and further decrease was observed at the end of 8 weeks. This is in accordance with other studies that had observed a concurrent fall in the Ca × P product during the nicotinamide treatment. But there were no changes in serum calcium and uric acid levels with nicotinamide treatment at the end of 8 weeks which is similar to that reported in the literature. ,,,
There was a slight decrease in mean creatinine and BUN levels, which was not statistically significant. Eto,  in an experimental study on rats with adenine-induced renal failure, reported that nicotinamide had protective effect against the deterioration of renal function by preventing the increase in BUN, serum creatinine levels and also increased the creatinine clearance in rats.
Regarding the adverse drug reactions of nicotinamide, watery stools were reported in seven patients and it resolved on continuation of therapy not requiring any dosage adjustment or therapy with other drugs. Thrombocytopenia that is commonly associated with niacinamide and nicotinic acid therapy was not reported by any of the patients. Other than alkaline phosphatase levels all the liver function tests were normal. Blood sugar levels were also not affected by nicotinamide therapy. Delanaye,  showed the occurrence of diarrhea in five of six patients enrolled in an open-label trial on the safety and efficacy of nicotinamide. The symptoms began at a mean nicotinamide dosage of 1050 ± 447 mg and resolved after drug cessation. In the study done by Takahashi,  the study cohort developed diarrhea when nicotinamide was administered alone and one patient showed statistically significant decrease in platelet count during nicotinamide treatment. However after washout the platelet count returned to pretreatment level.
Nicotinamide was also found to be a cost-effective therapy for hyperphosphatemia in HD as the cost of a nicotinamide 250 mg tablet (generic) was less than 1.00, whereas the costs of the other phosphate binders are as follows: 3.00 per tablet for nicotinic acid 375 mg (brand used: Nialip); calcium acetate 667 mg (brand used: Phostat) and calcium carbonate 500 mg (brand used: Shelcal); 16.50 per tablet for sevelamer hydrochloride 400 mg (brand used: Foseal) and 16.00 per tablet for Lanthanum carbonate 500 mg (brand used: Lanthonate).
The study had few limitations like short duration, small number of cases and non-estimation of lipid profile, parathyroid hormone levels and serum NAD concentrations due to financial constraints.
| Conclusion|| |
The present study shows that nicotinamide is safe and effective in controlling serum phosphorus, Ca × P product and alkaline phosphatase levels.
| References|| |
|1.||Melamed ML, Eutace JA, Plantinga L. Changes in serum calcium, phosphate, and PTH and the risk of death in incident dialysis patients: A longitudinal study. Kidney Int 2006;70:351-7. |
|2.||Block GA, Port FK. Re-evaluation of risk associated with hyperphosphatemia and hyperparathyroidism in dialysis patients: Recommendations for a change in management. Am J Kidney Dis 2000;35:1226-37. |
|3.||Block GA, Hulbert Shearon TE, Levin NW. Association of serum phosphorus and calcium-phosphate product with mortality risk in chronic hemodialysis patients: A National study. Am J Kidney Dis 1998;31:607-17. |
|4.||Taylor AJ, Burke AP, O'Malley PG, Farb A, Malcom GT, Smialek J, et al. A comparison of the Framingham risk index, coronary artery calcification and culprit plaque morphology in sudden cardiac death. Circulation 2000;101:1243-48. |
|5.||Block GA, Klassen PS, Lazarus JM, Ofsthun N, Lowrie EG, Chertow GM. Mineral metabolism, mortality, and morbidity in maintenance hemodialysis. J Am Soc Nephrol 2004;15:2208-18. |
|6.||Kalantar-Zadeh K, Kuwae N, Regidor DL, Kovesdy CP, Kilpatrick RD, Shinaberger CS, et al. Survival predictability of time-varying indicators of bone disease in maintenance hemodialysis patients. Kidney Int 2006;70:771-80. |
|7.||Rodriguez-Benot A, Martin-Malo A, Alvarez-Lara MA, Rodriguez M, Aljama P. Mild hyperphosphatemia and mortality in hemodialysis patients. Am J Kidney Dis 2005;46:68-77. |
|8.||National Kidney Foundation. K/DOQI Clinical practice guidelines for bone metabolism and disease in chronic kidney disease. Am J Kidney Dis. 2003;42:S1-S202. |
|9.||Kuhlmann MK. Management of hyperphosphataemia. Hemodial Int 2006;10:338-45. |
|10.||Manns B, Stevens L, Miskulin D, Owen WF Jr, Winkelmayer WC, Tonelli M. A systematic review of sevelamer in ESRD and an analysis of its potential economic impact in Canada and the United States. Kidney Int 2004;66:1239-47. |
|11.||Wills, Savory J. Aluminium poisoning: Dialysis encephalopathy, osteomalacia and anemia. Lancet 1983;2:29-34. |
|12.||Borràs M, Marco MP, Fernández E. Treatment with sevelamer decreases bicarbonate levels in peritoneal dialysis patients. Perit Dial Int 2002;22:737-8. |
|13.||McIntyre CW, Patel V, Taylor GS, Fluck RJ. A prospective study of combination therapy for hyperphosphatemia with calcium-containing phosphate binders and sevelamer in hypercalcaemic haemodialysis patients. Nephrol Dial Transplant 2002;17:1643-48. |
|14.||Al-Baaj F, Speake M, Hutchison AJ. Control of serum phosphate by oral lanthanum carbonate in patients undergoing haemodialysis and continuous ambulatory peritoneal dialysis in a short-term, placebo-controlled study. Nephrol Dial Transplant 2006;20:775-82. |
|15.||Block GA, Spiegel DM, Ehrlich J, Mehta R, Lindbergh J, Dreisbach A, et al. Effect of sevelamer and calcium on coronary artery calcification in patients new to hemodialysis. Kidney Int 2005;68:1815-42. |
|16.||Asmus HG, Braun J, Krause R, Brunkhorst R, Holzer H, Schulz W. Two year comparison of sevelamer and calcium carbonate effect on cardiovascular calcification and bone density. Nephrol Dial Transplant 2005;20:1653-61. |
|17.||Bogan KL, Brenner C. Nicotinic acid, nicotinamide, and nicotinamide riboside: A molecular evaluation of NAD+ precursor vitamins in human nutrition. Annu Rev Nutr 2008; 28:115-30. |
|18.||Denisi D, Caverzasio J, Trechsel U, Bonjour JP, Straub RW. Phosphate transport adaptation in rat jejunum and plasma level of 1,25-dihydroxyvitamin D3. Scand J Gastroenterol 1990;25:210-5. |
|19.||Katai K, Tanaka H, Tatsumi S. Nicotinamide inhibits sodium dependent phosphate cotransport activity in rat small intestine. Nephrol Dial Transplant 1999;14:1195-201. |
|20.||Kempson SA, Colon-Otero G, Ou SY, Turner ST, Dousa TP. Possible role of nicotinamide adenine dinucleotide as an intracellular regulator of renal transport of phosphate in the rat. J Clin Invest 1981;67:1347-60. |
|21.||Eto N, Miyata Y, Ohno H, Yamashita T. Nicotinamide prevents the development of hyperphosphatemia by suppressing intestinal sodium-dependent phosphate transporter in rats with a denin-induced renal failure. Nephrol Dial Transplant 2005;20:1378-84. |
|22.||Berndt TJ, Pfeifer JD, Knox FG, Kempson SA, Dousa TP. Nicotinamide restores phosphaturic effect of PTH and calcitonin in phosphate deprivation. Am J Physiol 1982; 242:F447-52. |
|23.||Morrow JD, Parsons WG, Roberts LJ. Release of markedly increased quanitites of prostaglandin D2 in vivo in humans following the administration of nicotinic acid. Prostaglandins. 1989;38:263-74. |
|24.||Meyers CD, Liu P, Kamanna VS, Kashyap ML. Nicotinic acid induces secretion of prostaglandin D2 in human macrophages: An in vitro model of the niacin flush. Atherosclerosis 2007;192: 253-8. |
|25.||Lorenzen A, Stannck C, Lang H, Andrianov V, Kalvinsh I, Schwabe U. Characterization of a G protein-coupled receptor for nicotinic acid. Mol Pharmacol 2001;59:349-357. |
|26.||Wise A, Ford S, Fraser N. Molecular identification of high and low affinity receptors for nicotinic acid. J Biol Chem 2003; 278:9869-74. |
|27.||Anonymous. Vitamin b complex niacin American hospital formulary service drug information. Bethesda: American society of hospital pharmacist;1985.p.1685-87. |
|28.||Anonymous. Nicotinic acid, nicotinamide. In: Reynolds JE (ed). Martindale: The extra pharmacopoeia (30 th ed), London: Pharmaceutical Press;1993.P.1045-46. |
|29.||Bingley PJ, Mahon JL, Gale EA. European Nicotinamide Diabetes Intervention Trial Group. Insulin resistance and progression to type 1 diabetes in the European Nicotinamide Diabetes Intervention Trial (ENDIT). Diabetes Care 2008;31:146-50. |
|30.||Mohler H, Polc P, Cumin R, Pieri L, Ketter R. Nicotinamide is a brain constituent with benzodiazepine like actions. Nature 1979;278:563-5. |
|31.||Bold JM, Gardner CR, Walker RJ. Central effects of niacinamide and inosine which are not mediated through benzodiazepine receptors. Br J Pharmac. 1985;84:689-96. |
|32.||Miesel R, Kurpisz M, Kroger H. Modulation of inflammatory arthritis by inhibition of poly (ADP ribose) polymerase. Inflammation 1995;19:379-87. |
|33.||Pero RW, Axelsson B, Siemann D, Chaplin D, Dougherty G. Newly discovered anti-inflammatory properties of the benzamides and nicotinamides. Mol Cell Biochem 1999;193:119-123. |
|34.||Ungerstedt JS, Blomback M, Soderstrom T. Nicotinamide is a potent inhibitor of proinflammatory cytokines. Clin Exp Immunol 2003;131:48-52. |
|35.||Knip M, DOUEK I F, Moore WPT, Gillmor HA, Mclean M. Safety of high dose of nicotinamide: A review. Diabetologia 2000;43:1337-45. |
|36.||Marcus R, Coulston AM. Water soluble vitamins. The vitamin B complex and ascorbic acid. In: Goodman-Gilman, editor. The pharmacological basis of therapeutics. 9 th ed, Newyork: Mc graw-hill;1996.p.1555-71. |
|37.||Cheng SC, Young DO, Huang Y, Delmez JA, Coyne DW. A randomized, double-blind, placebo-controlled trial of niacinamide for reduction of phosphorus in hemodialysis patients. Clin J Am Soc Nephrol 2008;3:1131-38. |
|38.||Takahashi Y, Tanaka A, Nakamura T, Fukuwatari T, Shibata k, Shimada N. Nicotinamide suppresses hyperphosphatemia in hemodialysis patients. Kidney Int 2004;65:1099-104. |
|39.||Sampathkumar K, Selvam M, Sooraj YS, Gowthaman S, Ajeshkumar RN. Extended release nicotinic acid - a novel oral agent for phosphate control. Int Urol Nephrol 2006;38(1):171-4. |
|40.||Muller D, Mehling H, Otto B, Bergmann-Lips R, Luft F, Jordan J, et al. Niacin lowers serum phosphate and increases HDL cholesterol in dialysis patients. Clin J Am Soc Nephrol 2007;2:1249-54. |
[Table 1], [Table 2], [Table 3], [Table 4]
|This article has been cited by|
||The efficacy and safety of niacin on hyperphosphatemia in ESRD patients undergoing hemodialysis: randomized controlled trial
| ||Hanan Mahmoud Ahmed, Esraa Yossif, Alaa S. Abd-Elkader, Essam M. Abdel Aziz |
| ||The Egyptian Journal of Internal Medicine. 2022; 34(1) |
|[Pubmed] | [DOI]|
||Biomarkers of heart and vascular lesions in the framework of mineral and bone disorders in chronic kidney disease, correction possibilities
| ||L. Yu. Milovanova, V. D. Beketov, S. Yu. Milovanova, M. V. Taranova, A. A. Filippova, A. I. Pasechnik |
| ||Clinical Medicine (Russian Journal). 2021; 99(4): 245 |
|[Pubmed] | [DOI]|
||Use of Nicotinamide to Treat Hyperphosphatemia in Dialysis Patients
| ||Aurélie Lenglet,Sophie Liabeuf,Pauline Guffroy,Albert Fournier,Michel Brazier,Ziad A. Massy |
| ||Drugs in R&D. 2013; 13(3): 165 |
|[Pubmed] | [DOI]|