nanonext
R binding for NNG (Nanomsg Next Gen), a successor to ZeroMQ. NNG is a socket library implementing ‘Scalability Protocols’, a reliable, high-performance standard for common communications patterns including publish/subscribe, request/reply and service discovery, over in-process, IPC, TCP, WebSocket and secure TLS transports.
As its own threaded concurrency framework, provides a toolkit for asynchronous programming and distributed computing, with intuitive ‘aio’ objects which resolve automatically upon completion of asynchronous operations, and synchronisation primitives allowing R to wait upon events signalled by concurrent threads.
Designed for performance and reliability,
nanonext
is a lightweight
wrapper around the NNG C library, and is itself implemented almost
entirely in C.
Provides the interface for code and processes to communicate with each other - receive data generated in Python, perform analysis in R, and send results to a C++ program – on the same computer or across networks spanning the globe.
Implemented scalability protocols:
- Bus (mesh networks)
- Pair (two-way radio)
- Poly (one-to-one of many)
- Push/Pull (one-way pipeline)
- Publisher/Subscriber (topics & broadcast)
- Request/Reply (RPC)
- Surveyor/Respondent (voting & service discovery)
Supported transports:
- inproc (intra-process)
- IPC (inter-process)
- TCP (IPv4 or IPv6)
- WebSocket
- TLS (over TCP and WebSocket)
Development of the TLS implementation was generously supported by the .
Web utilities:
- ncurl - (async) http(s) client
- stream - secure websockets client / generic low-level socket interface
messenger()
- console-based instant messaging with authentication
Quick Start
nanonext
offers 2 equivalent interfaces: a functional interface, and
an object-oriented interface.
Functional Interface
The primary object in the functional interface is the Socket. Use
socket()
to create a socket and dial or listen at an address. The
socket is then passed as the first argument of subsequent actions such
as send()
or recv()
.
Example using Request/Reply (REQ/REP) protocol with inproc transport: (The inproc transport uses zero-copy where possible for a much faster solution than alternatives)
Create sockets:
library(nanonext)
socket1 <- socket("req", listen = "inproc://nanonext")
socket2 <- socket("rep", dial = "inproc://nanonext")
Send message from ‘socket1’:
send(socket1, "hello world!")
#> [1] 0
Receive message using ‘socket2’:
recv(socket2)
#> [1] "hello world!"
Object-oriented Interface
The primary object in the object-oriented interface is the nano object.
Use nano()
to create a nano object which encapsulates a Socket and
Dialer/Listener. Methods such as $send()
or $recv()
can then be
accessed directly from the object.
Example using Pipeline (Push/Pull) protocol with TCP/IP transport:
Create nano objects:
library(nanonext)
nano1 <- nano("push", listen = "tcp://127.0.0.1:5555")
nano2 <- nano("pull", dial = "tcp://127.0.0.1:5555")
Send message from ‘nano1’:
nano1$send("hello world!")
#> [1] 0
Receive message using ‘nano2’:
nano2$recv()
#> [1] "hello world!"
Vignette
Please refer to the nanonext vignette for full package functionality.
This may be accessed within R by:
vignette("nanonext", package = "nanonext")
Installation
Install the latest release from CRAN:
install.packages("nanonext")
The current development version is available from R-universe:
install.packages("nanonext", repos = "https://shikokuchuo.r-universe.dev")
Building from Source
Linux / Mac / Solaris
Installation from source requires ‘libnng’ >= v1.6.0 and ‘libmbedtls’ >= 2.5.0 (suitable installations are automatically detected), or else ‘cmake’ to compile ‘libnng’ v1.8.0 (patched) and ‘libmbedtls’ v3.5.2 included within the package sources.
It is recommended for optimal performance and stability to let the
package automatically compile bundled versions of ‘libmbedtls’ and
‘libnng’ during installation. To ensure the libraries are compiled
from source even if system installations are present, set the
NANONEXT_LIBS
environment variable prior to installation e.g. by
Sys.setenv(NANONEXT_LIBS = 1)
.
As system libraries, ‘libnng’ is available as libnng-dev (deb) or
nng-devel (rpm), and ‘libmbedtls’ as libmbedtls-dev (deb) or
libmbedtls-devel (rpm). The INCLUDE_DIR
and LIB_DIR
environment
variables may be set prior to package installation to specify a custom
location for ‘libmbedtls’ or ‘libnng’ other than the standard filesystem
locations.
Additional requirements for Solaris: (i) the ‘xz’ package - available on OpenCSW, and (ii) a more recent version of ‘cmake’ than available on OpenCSW - refer to the ‘cmake’ website for the latest source file.
Windows
For R >= 4.2 using the ‘Rtools42’ or newer toolchains, ‘libnng’ v1.8.0 (patched) and ‘libmbedtls’ v3.5.2 will be automatically compiled from the package sources during installation.
For previous R versions, pre-compiled ‘libnng’ v1.8.0 (patched) and ‘libmbedtls’ v3.5.2 libraries are downloaded and used for installation instead.
Acknowledgements and Links
We would like to acknowledge in particular:
- Garrett D’Amore, author of the NNG
library, for generous advice and for implementing a feature request
specifically for a more efficient ‘aio’ implementation in
nanonext
. - The R Consortium for funding the development of the secure TLS capabilities in the package, and Henrik Bengtsson and Will Landau’s roles in making this possible.
- Joe Cheng for prototyping the
integration of
nanonext
withlater
to support the next generation of completely event-driven ‘promises’. - R Core for various auxiliary functions for serialisation and raw / character conversion, which have been adopted by the package.
- Luke Tierney and Mike Cheng for meticulous documentation of the R serialization mechanism, which led to the package’s own implementation of a low-level interface to R serialization.
- Jeroen Ooms - for his ‘Anticonf (tm)’ configure script, on which our original ‘configure’ was based, although much modified since.
Links:
◈ nanonext R package: https://shikokuchuo.net/nanonext/
nanonext is listed in CRAN Task Views:
- High Performance Computing: https://cran.r-project.org/view=HighPerformanceComputing
- Web Technologies: https://cran.r-project.org/view=WebTechnologies
NNG: https://nng.nanomsg.org/ Mbed TLS: https://www.trustedfirmware.org/projects/mbed-tls/
–
Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.