- Home
- Archives
- 2026
- Vol. 7 Issue 6
- Article
Sentence Boundary Detection in Colloquial Tamil Using Monolingual Adaptation and Fine-Tuned mBART50
Authors
1 Department of Information Technology, Sri Venkateswara College of Engineering, Sriperumbudur, Tamil Nadu, India. 2 Department of Computer Science and Engineering, Sri Venkateswara College of Engineering, Sriperumbudur, Tamil Nadu, India.
Article Information
- Published In
- Volume 7, Issue 6 (2026)
- Published Online
- November-December 2026
- Pages
- 100-105
- Article Type
- Original Article
References
1. D. Kakwani, A. Kunchukuttan, S. Golla, Gokul N. C., A. Bhattacharyya, M. M. Khapra, and P. Kumar, “IndicNLPSuite: Monolingual
Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages,” in Findings of the Association
for Computational Linguistics: EMNLP 2020, pp. 4948–4961, 2020. doi: 10.18653/v1/2020.findings-emnlp.445.
2. S. Doddapaneni, R. Aralikatte, G. Ramesh, S. Goyal, M. M. Khapra, A. Kunchukuttan, and P. Kumar, “Towards Leaving No Indic
Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages,” in Proceedings of the 61st Annual
Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 12402–12426, 2023. doi:
10.18653/v1/2023.acl-long.693.
3. T. Kiss and J. Strunk, “Unsupervised Multilingual Sentence Boundary Detection,” Computational Linguistics, vol. 32, no. 4, pp. 485–
525, 2006. doi: 10.1162/coli.2006.32.4.485.
4. N. Wanjari, G. M. Dhopavkar, and N. B. Zungre, “Sentence Boundary Detection for Marathi Language,” Procedia Computer Science,
vol. 78, pp.550–555, 2016. doi: 10.1016/j.procs.2016.02.101.
5. A. Melamud and A. Duran, “Punctuation Restoration for Speech Transcripts using seq2seq Transformers,” Journal of Student Research,
vol. 10, no.4, 2021. doi: 10.47611/jsrhs.v10i4.2249.
6. A. D. McCarthy, H. Zhang, S. Kumar, F. Stahlberg, and K. Wu, “Long-Form Speech Translation through Segmentation with Finite-
State Decoding Constraints on Large Language Models,” in Findings of the Association for Computational Linguistics: EMNLP 2023,
pp. 247–257, 2023. doi: 10.18653/v1/2023.findings-emnlp.19.
7. Z. Chen, “Sentence Segmentation and Sentence Punctuation Based on XunziALLM,” in Proceedings of the Third Workshop on
Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024, pp. 246–250, 2024.
8. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention Is All You Need,” in
Advances in Neural Information Processing Systems, vol. 30, pp. 5998–6008, 2017.
9. Y. Liu, J. Gu, N. Goyal, X. Li, S. Edunov, M. Ghazvininejad, M. Lewis, and L. Zettlemoyer, “Multilingual Denoising Pre-training
for Neural Machine Translation,” Transactions of the Association for Computational Linguistics, vol. 8, pp. 726–742, 2020. doi:
10.1162/tacl_a_00343.
10. Y. Tang, C. Tran, X. Li, P.-J. Chen, N. Goyal, V. Chaudhary, J. Gu, and A. Fan, “Multilingual Translation with Extensible Multilingual
Pretraining and Finetuning,” arXiv preprint arXiv:2008.00401, 2020. doi: 10.48550/arXiv.2008.00401.
11. R. Dabre, H. Shrotriya, A. Kunchukuttan, R. Puduppully, M. M. Khapra, and P. Kumar, “IndicBART: A Pre-trained Model for Indic
Natural Language Generation,” in Findings of the Association for Computational Linguistics: ACL 2022, pp. 1849–1863, 2022. doi:
10.18653/v1/2022.findings-acl.145.
12. P. Qi, Y. Zhang, Y. Zhang, J. Bolton, and C. D. Manning, “Stanza: A Python Natural Language Processing Toolkit for Many Human
Languages,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations,
pp. 101–108, 2020. doi: 10.18653/v1/2020.acl-demos.14.
Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages,” in Findings of the Association
for Computational Linguistics: EMNLP 2020, pp. 4948–4961, 2020. doi: 10.18653/v1/2020.findings-emnlp.445.
2. S. Doddapaneni, R. Aralikatte, G. Ramesh, S. Goyal, M. M. Khapra, A. Kunchukuttan, and P. Kumar, “Towards Leaving No Indic
Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages,” in Proceedings of the 61st Annual
Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 12402–12426, 2023. doi:
10.18653/v1/2023.acl-long.693.
3. T. Kiss and J. Strunk, “Unsupervised Multilingual Sentence Boundary Detection,” Computational Linguistics, vol. 32, no. 4, pp. 485–
525, 2006. doi: 10.1162/coli.2006.32.4.485.
4. N. Wanjari, G. M. Dhopavkar, and N. B. Zungre, “Sentence Boundary Detection for Marathi Language,” Procedia Computer Science,
vol. 78, pp.550–555, 2016. doi: 10.1016/j.procs.2016.02.101.
5. A. Melamud and A. Duran, “Punctuation Restoration for Speech Transcripts using seq2seq Transformers,” Journal of Student Research,
vol. 10, no.4, 2021. doi: 10.47611/jsrhs.v10i4.2249.
6. A. D. McCarthy, H. Zhang, S. Kumar, F. Stahlberg, and K. Wu, “Long-Form Speech Translation through Segmentation with Finite-
State Decoding Constraints on Large Language Models,” in Findings of the Association for Computational Linguistics: EMNLP 2023,
pp. 247–257, 2023. doi: 10.18653/v1/2023.findings-emnlp.19.
7. Z. Chen, “Sentence Segmentation and Sentence Punctuation Based on XunziALLM,” in Proceedings of the Third Workshop on
Language Technologies for Historical and Ancient Languages (LT4HALA) @ LREC-COLING-2024, pp. 246–250, 2024.
8. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention Is All You Need,” in
Advances in Neural Information Processing Systems, vol. 30, pp. 5998–6008, 2017.
9. Y. Liu, J. Gu, N. Goyal, X. Li, S. Edunov, M. Ghazvininejad, M. Lewis, and L. Zettlemoyer, “Multilingual Denoising Pre-training
for Neural Machine Translation,” Transactions of the Association for Computational Linguistics, vol. 8, pp. 726–742, 2020. doi:
10.1162/tacl_a_00343.
10. Y. Tang, C. Tran, X. Li, P.-J. Chen, N. Goyal, V. Chaudhary, J. Gu, and A. Fan, “Multilingual Translation with Extensible Multilingual
Pretraining and Finetuning,” arXiv preprint arXiv:2008.00401, 2020. doi: 10.48550/arXiv.2008.00401.
11. R. Dabre, H. Shrotriya, A. Kunchukuttan, R. Puduppully, M. M. Khapra, and P. Kumar, “IndicBART: A Pre-trained Model for Indic
Natural Language Generation,” in Findings of the Association for Computational Linguistics: ACL 2022, pp. 1849–1863, 2022. doi:
10.18653/v1/2022.findings-acl.145.
12. P. Qi, Y. Zhang, Y. Zhang, J. Bolton, and C. D. Manning, “Stanza: A Python Natural Language Processing Toolkit for Many Human
Languages,” in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations,
pp. 101–108, 2020. doi: 10.18653/v1/2020.acl-demos.14.
Related Articles
Share Article
*Instagram doesn't support direct link sharing from web. Copy the link and share it in your Instagram story or post.