I need to execute a python script on the jupyter kernel gateway through the websocket mode of the API.
Not sure if this is can be accomplished via the websocket mode, as there is hardly any resource available online and the docs for this particular personality is not very suggestive.
My question: How do we accomplish this?
p.s. This is not the same scenario as accomplished by http-mode to run code already present in a static notebook.
Any leads would be very helpful!
Yes, it can be accomplished. There is no extra documentation for it, because the API for kernels and code execution provided by Jupyter Kernel Gateway is the exact same as for Jupyter Notebook.
Depending on the client language you're using, there may be client libraries that make the task simpler. For Javascript, give #jupyterlab/services a try.
Related
I would like to run a notebook cell automatically via REST API to make the usability of a dev tool we created better. Is that possible in databricks?
Yes, it's possible by using an older API version 1.2. You need to create an execution context with /api/1.2/contexts/create API (it requires cluster ID and what language is used), and then you can submit code using the /api/1.2/commands/execute API, and get command execution status using /api/1.2/commands/status API. Please note that you need to keep context to execute multiple commands depending on each other...
You can find an example of such execution using the Go language in the source code of Databricks Terraform provider
Cloud instances like google colab, paperspace gradient etc. offer free or very inexpensive options at ~10$/months for storage, GPU compute, ready-to-use containers and a jupyter notebook/lab IDE. It's great for hobby prototypes.
However, personally, I much prefer IDEs like VSCode for developing even small projects. Given that VSCode offers ssh-remote access to machines and even docker containers, what are the best options to realize this? Already tried colab-ssh which works but feels a bit sluggish. Maybe there are better options?
On the other side, one can rent instances like AWS p2.xlarge, but with costs of 1$/h they become significantly more expensive than the above options (sidenote: Why is there such a discrepancy?)
SSH onto notebook server
Most managed notebook services don't allow/support SSH.
Colab states this in its terms of service.
Paperspace also seems to not support it (according to this forum thread from 2018).
It may be possible with Sagemaker if you set up a bastion host.
VS Code server
VS Code server you lets you run VS Code on the notebook server, and connect through a local VS Code without SSH.
in Colab: colabcode
in Paperspace: gradient-coder
On the client side you can connect via the Remote - Tunnels extension.
I found many questions about same issue in Stackoverflow. But could not find any satisfactory answers.
My problem is:
I have to run "iperf client" in client machine(assuming windows) using command line in client windows machine and get the statistics.
Currently my server is written in PHP(I am ready to shift to any platform) given that I shall be able to run iperf command on client machine.
I searched and found that, Java applet, ActiveX control or Plugins(like Google Talk plugin). Can someone suggest me the best and easiest approach here(with some reference links if possible).
You cannot run an arbitrary command on the client side using Native Client. What you can do is invoke Pepper API functions from your extension. Another thing you can do is access the Chrome extension API from Javascript. If none of these have the information you need, feel free to suggest new features on the native-client-discuss mailing list. Note that invoking "any Windows command" cannot be reasonably made part of a client-side application, due to security issues.
I'm looking for something analogous to Capistrano for Rails - https://github.com/capistrano/capistrano/wiki/
I'd like to be able to run a single command from my workstation that will update the code on my server(s) from a GitHub project and handle all necessary process restarting for the application. I need to be able to control specifically when this happens, not use a hook in GitHub's checkin event.
Are Node.js developers also using Capistrano, or is there a tool that works better for Node.js?
You could use fabric, it's a python lib. Nodejs already uses python for some build operations for extensions, no reason you couldn't also use python to do what you're asking.
http://docs.fabfile.org/en/1.2.2/index.html
I don't know of a javascript lib that does this, not to say there isn't one though. Fabric sounds very much like what capistrano is, but maybe a tiny bit different in some aspects.
Capistrano seems to be the most popular choice.
I have written a program in PowerShell that loops and checks stuff.
I would like to convert this into a Windows service.
I've created a Windows service (in Admin->Services) but I can't start it.
I'm pretty sure I'm missing the proper interface that the system needs to call into in order to start/stop/pause/etc the service.
I can find plenty of examples when it comes to doing it in VB/C#/MS-lang but nothing about how to do it using PowerShell. Is there any documentation (or preferably code examples) out there to help with this?
There are a few items at issue here:
Are you sure that you really need a service? I agree with the comments about using the scheduler for running periodic tasks. The scheduler can start tasks as Administrator.
Services call a special set of APIs to communicate with the Service Control Manager, so an ordinary program can't be used directly.
The Service Control Manager uses CreateProcessAsUser to start the service process, so you need to point the SCM to an executable binary, as opposed to a script.
If you can't use the scheduler (though I strongly encourage you to try), I suppose that you could write an executable binary that acts as a service. It would then execute PowerShell and your script on your behalf. I'm thinking something like the srvany program that used to be included with the Windows Server 2003 Resource Kit could bootstrap the service for you.
If you absolutly want to execute your PowerShell code into a service, I think you can write a C# service wrapper for PowerShell code.
You found examples of how to create a service with C#, and it's simple to call Powershell from C#. So I'am surprised that as small SrvAny oriented PowerShell does not exists yet.
My advice here, you better rewrite your code in C# as a service.
You can use the Compile Script into Service option of PowerGUI: http://documents.software.dell.com/DOC144271
I think what you are looking for is SrvAny.exe from Microsoft (I don't know that they support it any longer, but it has been around in the Windows 2000 Resource Kit for years. It will essentially turn just about any executable (.exe, .cmd, etc...) into a service. I have VBScripts running as quasi-services using Srvany.exe and it works on Windows 2003 and Windows 2008 (even 64 bit). It is a little limited in that it does not provide 100% service functionality (stopping a running script may be difficult) but if you now a bit about programming and the Windows environment you can adapt it to work pretty well (i.e. it will launch the program after server Restart/Startup as you would likely need from a service. There is some documentation with SrvAny.exe (although it can be a little obtuse and difficult to find). It is however Free and built for Windows so it should work for you.
I agree for simplicity that the Scheduled Task idea is worth thinking about as it is even more simplistic that srvany.exe
http://www.firedaemon.com/
Will allows you start littery anything as a service. There are also free alternatives to this application, that does the same.