Disnix: A toolset for distributed deployment

doi:10.1016/j.scico.2012.03.006

Science of Computer Programming

Volume 79, 1 January 2014, Pages 52-69

https://doi.org/10.1016/j.scico.2012.03.006 Get rights and content

Under an Elsevier user license

open archive

Abstract

The process of deploying a distributed system in a network of machines is often very complex, laborious and time-consuming, while it is hard to guarantee that the system will work as expected and that specific non-functional deployment requirements from the domain are supported. In this paper we describe the Disnix toolset, which provides system administrators or developers with automatic deployment of a distributed system in a network of machines from declarative specifications and offers properties such as complete dependencies, atomic upgrades and rollbacks to make this process efficient and reliable. Disnix has an extensible architecture, allowing the integration of custom modules to make the deployment more convenient and suitable for the domain in which the system is to be used. Disnix has been under development for almost four years and has been applied to several types of distributed systems, including an industrial case study.

Highlights

► Automated, reliable deployment of heterogeneous service-oriented systems in networks. ► Automatic, reliable and efficient distributed upgrades. ► Reproducible distributed deployment configurations. ► Support for deployment and testing service-oriented systems in virtual networks. ► Free and Open-Source tools and publicly available hands-on example cases.

Keywords

Software deployment

Distributed systems

Service-oriented systems

View PDF

References

[1]
M.P. Papazoglou, P. Traverso, S. Dustdar, F. Leymann
Service-oriented computing: state of the art and research challenges
Computer, 40 (2007), pp. 38-45
View in Scopus Google Scholar
[2]
A. Akkerman, A. Totok, V. Karamcheti
Infrastructure for Automatic Dynamic Deployment of J2EE Applications in Distributed Environments
CD ’05: Proc. of the 3rd Working Conf. on Component Deployment, Springer-Verlag (2005), pp. 17-32
View at publisherCrossref View in Scopus Google Scholar
[3]
E. Caron, P.K. Chouhan, H. Dail, GoDIET: a Deployment Tool for Distributed Middleware on Grid 5000, Technical Report RR-5886, Laboratoire de l’Informatique du Parallélisme (LIP), 2006.
Google Scholar
[4]
R.S. Hall, D. Heimbigner, A.L. Wolf
A cooperative approach to support software deployment using the software dock
ICSE ’99: Proc. of the 21st Intl. Conf. on Software Engineering, ACM, New York, NY, USA (1999), pp. 174-183
View in Scopus Google Scholar
[5]
E. Dolstra, E. Visser, M. de Jonge
Imposing a memory management discipline on software deployment
Proc. 26th Intl. Conf. on Software Engineering (ICSE 2004), IEEE Computer Society (2004), pp. 583-592
View in Scopus Google Scholar
[6]
E. Dolstra, The Purely Functional Software Deployment Model, Ph.D. thesis, Faculty of Science, Utrecht University, The Netherlands, 2006.
Google Scholar
[7]
M. de Jonge, W. van der Linden, R. Willems, eServices for Hospital Equipment, in: B. Krämer, K.-J. Lin, P. Narasimhan (Eds.), 5th Intl. Conf. on Service-Oriented Computing (ICSOC 2007), pp. 391–397.
Google Scholar
[8]
S. van der Burg, E. Dolstra, M. de Jonge
Atomic upgrading of distributed systems
T. Dumitraş, D. Dig, I. Neamtiu (Eds.), First ACM Workshop on Hot Topics in Software Upgrades (HotSWUp), ACM (2008)
Google Scholar
[9]
S. van der Burg, E. Dolstra
Automated deployment of a heterogeneous service-oriented system
36th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), IEEE Computer Society (2010)
Google Scholar
[10]
MaxMind - GeoIP — IP Address Location Technology. http://www.maxmind.com/app/ip-location, 2010.
Google Scholar
[11]
E. Foster-Johnson
Red Hat RPM Guide
John Wiley & Sons (2003)
Google Scholar
[12]
E.S. Raymond, The Art of Unix Programming, Thyrsus Enterprises, 2003. Also available at: http://www.faqs.org/docs/artu.
Google Scholar
[13]
D. Skeen, M. Stonebraker
A formal model of crash recovery in a distributed system
Concurrency Control and Reliability in Distributed Systems, Van Nostrand Reinhold Co., New York, NY, USA (1987), pp. 295-317
Google Scholar
[14]
freedesktop.org - software/dbus. http://www.freedesktop.org/wiki/Software/dbus, 2010.
Google Scholar
[15]
Graphviz. http://www.graphviz.org, 2010.
Google Scholar
[16]
E. Dolstra, A. Löh
NixOS: a purely functional Linux distribution
ICFP 2008: 13th ACM SIGPLAN Intl. Conf. on Functional Programming, ACM (2008)
Google Scholar
[17]
S. van der Burg, E. Dolstra
Automating system tests using declarative virtual machines
21st IEEE International Symposium on Software Reliability Engineering (ISSRE 2010), IEEE Computer Society (2010)
Google Scholar
[18]
M.J. Rutherford, K.M. Anderson, A. Carzaniga, D. Heimbigner, A.L. Wolf
Reconfiguration in the Enterprise JavaBean Component Model
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 67-81
View at publisher
Crossref View in Scopus Google Scholar
[19]
M. Mikic-Rakic, N. Medvidovic
Architecture-level support for software component deployment in resource constrained environments
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 31-50
View at publisher
Crossref View in Scopus Google Scholar
[20]
X. Chen, M. Simons
A component framework for dynamic reconfiguration of distributed systems
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 82-96
View at publisher
Crossref View in Scopus Google Scholar
[21]
P. Costanza
Dynamic Replacement of Active Objects in the Gilgul Programming Language
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 125-140
View at publisher
Crossref View in Scopus Google Scholar
[22]
G.v. Laszewski, E. Blau, M. Bletzinger, J. Gawor, P. Lane, S. Martin, M. Russell
Software, component, and service deployment in computational grids
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 244-256
Google Scholar
[23]
H. Roussain, F. Guidec
Cooperative component-based software deployment in wireless ad hoc networks
CD ’05: Proc. of the 3rd Working Conf. on Component Deployment, Springer-Verlag (2005), pp. 1-15
View at publisherCrossref View in Scopus Google Scholar
[24]
T. Dumitras, J. Tan, Z. Gho, P. Narasimhan
No more HotDependencies: toward dependency-agnostic online upgrades in distributed systems
HotDep’07: Proc. of the 3rd workshop on Hot Topics in System Dependability, USENIX Association, Berkeley, CA, USA (2007), p. 14
Google Scholar
[25]
N.P. Sudmann, D. Johansen
Software deployment using mobile agents
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 97-107
View at publisher
Crossref View in Scopus Google Scholar
[26]
T. Eilam, M. Kalantar, A. Konstantinou, G. Pacifici, J. Pershing, A. Agrawal
Managing the configuration complexity of distributed applications in internet data centers
Communications Magazine, IEEE, 44 (2006), pp. 166-177
View in Scopus Google Scholar
[27]
A.V. Konstantinou, T. Eilam, M. Kalantar, A.A. Totok, W. Arnold, E. Snible
An architecture for virtual solution composition and deployment in infrastructure clouds
Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing, VTDC ’09, ACM, New York, NY, USA (2009), pp. 9-18
View at publisherCrossref Google Scholar
[28]
K. El Maghraoui, A. Meghranjani, T. Eilam, M. Kalantar, A.V. Konstantinou
Model driven provisioning: bridging the gap between declarative object models and procedural provisioning tools
Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, Middleware ’06, Springer-Verlag New York, Inc., New York, NY, USA (2006), pp. 404-423
View at publisher
Crossref View in Scopus Google Scholar
[29]
S. van der Burg, E. Dolstra
A self-adaptive deployment framework for service-oriented systems
6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), ACM (2011)
Google Scholar
[30]
H. Chen, J. Yu, R. Chen, B. Zang, P.-C. Yew
Polus: a powerful live updating system
Proceedings of the 29th International Conference on Software Engineering, ICSE ’07, IEEE Computer Society, Washington, DC, USA (2007), pp. 271-281
View at publisherCrossref Google Scholar

Supplementary data

The following is the Supplementary material to this article. Download: Download zip file (6MB)

MMC S1. Supplement file for “Disnix: A toolset for distributed deployment”.

Cited by (8)

Automatic deployment of distributed software systems: Definitions and state of the art
2015, Journal of Systems and Software
Citation Excerpt :
It is the case for Software Dock (Hall et al., 1999) and QUIET (Manzoor and Nefti, 2010) which aim at deploying automatically over networks and whose both architectures are based on mobile agents. Disnix proposes another solution for automatic deployment based on models (van der Burg and Dolstra, 2014). Finally, RAC fully automates the installation and configuration of virtual machines (VM) for cloud computing, and removes the human from the loop (Liu, 2011).
SERVICE DEPLOYMENT CHALLENGES IN CLOUD-TO-EDGE CONTINUUM
2021, Scalable Computing
High-order Typed Verifiable Application System Architecture Modelling and Its Case
2020, Ruan Jian Xue Bao/Journal of Software
Automatic Application Placement and Adaptation in Cloud-Edge Environments
2019, IEEE International Conference on Emerging Technologies and Factory Automation, ETFA
Enabling and monitoring platform for cloud-based applications
2018, International Journal of High Performance Computing and Networking
Unattended deployment of enabling platforms for cloud-based applications
2016, Proceedings - IEEE 30th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2016

View all citing articles on Scopus

[1] [1]
M.P. Papazoglou, P. Traverso, S. Dustdar, F. Leymann
Service-oriented computing: state of the art and research challenges
Computer, 40 (2007), pp. 38-45
View in Scopus Google Scholar

[2] [2]
A. Akkerman, A. Totok, V. Karamcheti
Infrastructure for Automatic Dynamic Deployment of J2EE Applications in Distributed Environments
CD ’05: Proc. of the 3rd Working Conf. on Component Deployment, Springer-Verlag (2005), pp. 17-32
View at publisherCrossref View in Scopus Google Scholar

[3] [3]
E. Caron, P.K. Chouhan, H. Dail, GoDIET: a Deployment Tool for Distributed Middleware on Grid 5000, Technical Report RR-5886, Laboratoire de l’Informatique du Parallélisme (LIP), 2006.
Google Scholar

[4] [4]
R.S. Hall, D. Heimbigner, A.L. Wolf
A cooperative approach to support software deployment using the software dock
ICSE ’99: Proc. of the 21st Intl. Conf. on Software Engineering, ACM, New York, NY, USA (1999), pp. 174-183
View in Scopus Google Scholar

[5] [5]
E. Dolstra, E. Visser, M. de Jonge
Imposing a memory management discipline on software deployment
Proc. 26th Intl. Conf. on Software Engineering (ICSE 2004), IEEE Computer Society (2004), pp. 583-592
View in Scopus Google Scholar

[6] [6]
E. Dolstra, The Purely Functional Software Deployment Model, Ph.D. thesis, Faculty of Science, Utrecht University, The Netherlands, 2006.
Google Scholar

[7] [7]
M. de Jonge, W. van der Linden, R. Willems, eServices for Hospital Equipment, in: B. Krämer, K.-J. Lin, P. Narasimhan (Eds.), 5th Intl. Conf. on Service-Oriented Computing (ICSOC 2007), pp. 391–397.
Google Scholar

[8] [8]
S. van der Burg, E. Dolstra, M. de Jonge
Atomic upgrading of distributed systems
T. Dumitraş, D. Dig, I. Neamtiu (Eds.), First ACM Workshop on Hot Topics in Software Upgrades (HotSWUp), ACM (2008)
Google Scholar

[9] [9]
S. van der Burg, E. Dolstra
Automated deployment of a heterogeneous service-oriented system
36th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), IEEE Computer Society (2010)
Google Scholar

[10] [10]
MaxMind - GeoIP — IP Address Location Technology. http://www.maxmind.com/app/ip-location, 2010.
Google Scholar

[11] [11]
E. Foster-Johnson
Red Hat RPM Guide
John Wiley & Sons (2003)
Google Scholar

[12] [12]
E.S. Raymond, The Art of Unix Programming, Thyrsus Enterprises, 2003. Also available at: http://www.faqs.org/docs/artu.
Google Scholar

[13] [13]
D. Skeen, M. Stonebraker
A formal model of crash recovery in a distributed system
Concurrency Control and Reliability in Distributed Systems, Van Nostrand Reinhold Co., New York, NY, USA (1987), pp. 295-317
Google Scholar

[14] [14]
freedesktop.org - software/dbus. http://www.freedesktop.org/wiki/Software/dbus, 2010.
Google Scholar

[15] [15]
Graphviz. http://www.graphviz.org, 2010.
Google Scholar

[16] [16]
E. Dolstra, A. Löh
NixOS: a purely functional Linux distribution
ICFP 2008: 13th ACM SIGPLAN Intl. Conf. on Functional Programming, ACM (2008)
Google Scholar

[17] [17]
S. van der Burg, E. Dolstra
Automating system tests using declarative virtual machines
21st IEEE International Symposium on Software Reliability Engineering (ISSRE 2010), IEEE Computer Society (2010)
Google Scholar

[18] [18]
M.J. Rutherford, K.M. Anderson, A. Carzaniga, D. Heimbigner, A.L. Wolf
Reconfiguration in the Enterprise JavaBean Component Model
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 67-81
View at publisher
Crossref View in Scopus Google Scholar

[19] [19]
M. Mikic-Rakic, N. Medvidovic
Architecture-level support for software component deployment in resource constrained environments
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 31-50
View at publisher
Crossref View in Scopus Google Scholar

[20] [20]
X. Chen, M. Simons
A component framework for dynamic reconfiguration of distributed systems
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 82-96
View at publisher
Crossref View in Scopus Google Scholar

[21] [21]
P. Costanza
Dynamic Replacement of Active Objects in the Gilgul Programming Language
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 125-140
View at publisher
Crossref View in Scopus Google Scholar

[22] [22]
G.v. Laszewski, E. Blau, M. Bletzinger, J. Gawor, P. Lane, S. Martin, M. Russell
Software, component, and service deployment in computational grids
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 244-256
Google Scholar

[23] [23]
H. Roussain, F. Guidec
Cooperative component-based software deployment in wireless ad hoc networks
CD ’05: Proc. of the 3rd Working Conf. on Component Deployment, Springer-Verlag (2005), pp. 1-15
View at publisherCrossref View in Scopus Google Scholar

[24] [24]
T. Dumitras, J. Tan, Z. Gho, P. Narasimhan
No more HotDependencies: toward dependency-agnostic online upgrades in distributed systems
HotDep’07: Proc. of the 3rd workshop on Hot Topics in System Dependability, USENIX Association, Berkeley, CA, USA (2007), p. 14
Google Scholar

[25] [25]
N.P. Sudmann, D. Johansen
Software deployment using mobile agents
CD ’02: Proc. of the IFIP/ACM Working Conf. on Component Deployment, Springer-Verlag (2002), pp. 97-107
View at publisher
Crossref View in Scopus Google Scholar

[26] [26]
T. Eilam, M. Kalantar, A. Konstantinou, G. Pacifici, J. Pershing, A. Agrawal
Managing the configuration complexity of distributed applications in internet data centers
Communications Magazine, IEEE, 44 (2006), pp. 166-177
View in Scopus Google Scholar

[27] [27]
A.V. Konstantinou, T. Eilam, M. Kalantar, A.A. Totok, W. Arnold, E. Snible
An architecture for virtual solution composition and deployment in infrastructure clouds
Proceedings of the 3rd International Workshop on Virtualization Technologies in Distributed Computing, VTDC ’09, ACM, New York, NY, USA (2009), pp. 9-18
View at publisherCrossref Google Scholar

[28] [28]
K. El Maghraoui, A. Meghranjani, T. Eilam, M. Kalantar, A.V. Konstantinou
Model driven provisioning: bridging the gap between declarative object models and procedural provisioning tools
Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, Middleware ’06, Springer-Verlag New York, Inc., New York, NY, USA (2006), pp. 404-423
View at publisher
Crossref View in Scopus Google Scholar

[29] [29]
S. van der Burg, E. Dolstra
A self-adaptive deployment framework for service-oriented systems
6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), ACM (2011)
Google Scholar

[30] [30]
H. Chen, J. Yu, R. Chen, B. Zang, P.-C. Yew
Polus: a powerful live updating system
Proceedings of the 29th International Conference on Software Engineering, ICSE ’07, IEEE Computer Society, Washington, DC, USA (2007), pp. 271-281
View at publisherCrossref Google Scholar