Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime
Sameer Shukla1
Section:Research Paper, Product Type: Journal Paper
Volume-10 ,
Issue-7 , Page no. 27-30, Jul-2022
CrossRef-DOI: https://doi.org/10.26438/ijcse/v10i7.2730
Online published on Jul 31, 2022
Copyright © Sameer Shukla . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
View this paper at Google Scholar | DPI Digital Library
How to Cite this Paper
- IEEE Citation
- MLA Citation
- APA Citation
- BibTex Citation
- RIS Citation
IEEE Style Citation: Sameer Shukla, “Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime,” International Journal of Computer Sciences and Engineering, Vol.10, Issue.7, pp.27-30, 2022.
MLA Style Citation: Sameer Shukla "Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime." International Journal of Computer Sciences and Engineering 10.7 (2022): 27-30.
APA Style Citation: Sameer Shukla, (2022). Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime. International Journal of Computer Sciences and Engineering, 10(7), 27-30.
BibTex Style Citation:
@article{Shukla_2022,
author = {Sameer Shukla},
title = {Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {7 2022},
volume = {10},
Issue = {7},
month = {7},
year = {2022},
issn = {2347-2693},
pages = {27-30},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=5496},
doi = {https://doi.org/10.26438/ijcse/v10i7.2730}
publisher = {IJCSE, Indore, INDIA},
}
RIS Style Citation:
TY - JOUR
DO = {https://doi.org/10.26438/ijcse/v10i7.2730}
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=5496
TI - Debugging Microservices with Pandas, PySpark using Actuators and Logs at Runtime
T2 - International Journal of Computer Sciences and Engineering
AU - Sameer Shukla
PY - 2022
DA - 2022/07/31
PB - IJCSE, Indore, INDIA
SP - 27-30
IS - 7
VL - 10
SN - 2347-2693
ER -
VIEWS | XML | |
367 | 572 downloads | 150 downloads |
Abstract
Microservices architecture is distributed in nature and the expectation is the services in the architecture must be highly available and responsive. Services in the architecture can scale from 1 to 100s and the distributed architecture is complex, and the chances of failure are higher when services communicate to each other. The main advantage of microservice architecture is we can easily mix technologies depending upon the nature of service, if the service is CPU or IO bound then we can develop the service based on the language or framework of our choice, similarly if we have hundreds of services in our architecture than we can build a proper debugging system for our microservices using any platform / frameworks two such libraries are Pandas or PySpark. This paper focuses on creating our own debugging tool in the Microservices architecture using python-based libraries PySpark and Pandas and the concept of Actuators.
Key-Words / Index Term
Microservice,Pandas,Spark,Actuator,SpringBoot,PyActuator,DataFrames
References
[1] Badidi, E. (2013) “A Framework for Software-As-A-Service Selection and Provisioning”. In: International Journal of Computer Networks & Communications (IJCNC), 5 (3): 189-200, 2013.
[2] F. Montesi and J. Weber, “Circuit Breakers, Discovery, and API Gateways in Microservices,” ArXiv160905830 Cs, Sep. 2016
[3] Kratzke, N. (2015) “About Microservices, Containers and their Underestimated Impact on Network Performance”. At the CLOUD Comput. 2015, 180, 2015. https://arxiv.org/abs/1710.04049
[4] Kitchenham, B., Brereton, O. P., Budgen, D., Turner, M., Bailey, J., and Linkman, S. (2009). Systematic literature reviews in software engineering–a systematic literature review. Information and software technology, 51(1):7–15, 2009.
[5] Zimmermann, O. (2009). An architectural decision modeling framework for service oriented architecture design. PhD thesis, Universitat Stuttgart. 2009.
[6] Nick Pentreath, Machine Learning with Spark, Beijing, pp. 1-140, 2015.
[7] Bryant, P. G. and Smith, M (1995) Practical Data Analysis: Case Studies in Business Statistics. Homewood, IL: Richard D. Irwin Publishing: 1995.
[8] K. Petersen, S. Vakkalanka, and L. Kuzniarz. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64:1–18, 2015.
[9] C. Wohlin. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, pages 38:1–38:10, New York, NY, USA, 2014. ACM
[10] C. Wohlin, P. Runeson, M. Host, M. Ohlsson, B. Regnell, ¨ and A. Wesslen. ´ Experimentation in Software Engineering. Computer Science. Springer, 2012.
[11] B. A. Kitchenham and S. Charters. Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE-2007-01, Keele University and University of Durham, 2007
[12] P. Kruchten. What do software architects really do? Journal of Systems and Software, 81(12), 2008
[13] Kornacker, M. et al. Impala: A modern, open-source SQL engine for Hadoop. In Proceedings of the Seventh Biennial CIDR Conference on Innovative Data Systems Research, Asilomar, CA, Jan. 4–7, 2015
[14] Isard, M. et al. Dryad: Distributed data-parallel programs from sequential building blocks. In Proceedings of the EuroSys Conference (Lisbon, Portugal, Mar. 21–23). ACM Press, New York, 2007.