n.eko (m1k1o fork)

This app uses Web RTC to stream a desktop inside of a docker container. This is fork of https://github.com/nurdism/neko.

For n.eko room management software visit https://github.com/m1k1o/neko-rooms.

Differences to original repository.

New Features

• Clipboard button with text area - for browsers, that don't support clipboard syncing (FireFox, what a shame...) or for HTTP.
• Keyboard modifier state synchronization (Num Lock, Caps Lock, Scroll Lock) for each hosting.
• Added chromium ungoogled (with h265 support) an kept up to date (by @whalehub).
• Added Picture in Picture button (only for watching screen, controlling not possible).
• Added RTMP broadcast. Enables broadcasting neko screen to local RTMP server, YouTube or Twitch.
• Stereo sound (works properly only in Firefox host).
• Added limited support for some mobile browsers with playsinline attribute.
• Added VIDEO_BITRATE and AUDIO_BITRATE in kbit/s to control stream quality (in collaboration with @mbattista).
• Added MAX_FPS, where you can specify max WebRTC frame rate. When set to 0, frame rate won't be capped and you can enjoy your real 60fps experience. Originally, it was constant at 25fps.
• Invite links. You can invite people and they don't need to enter passwords by themselves (and get confused about user accounts that do not exits). You can put your password in URL using ?pwd=<your-password> and it will be automatically used when logging in.
• Added /stats?pwd=<admin> endpoint to get total active connections, host and members.
• Added m1k1o/neko:vlc tag, use VLC to watch local files together (by @mbattista).
• Added m1k1o/neko:xfce tag, as an non video related showcase (by @mbattista).
• Added ARM-based images, for Raspberry Pi support (by @mbattista).
• Added simple language picker.
• Added ?usr=<display-name> that will prefill username. This allows creating auto-join links.
• Added ?cast=1 that will hide all control and show only video.
• Shake keyboard icon if someone attempted to control when is nobody hosting.
• Support for password protected NEKO_ICESERVERS (by @mbattista).

Bugs

• Fixed minor gst pipeline bug.
• Locked screen only for users, admins can still join.
• Fixed h264 pipelines bugs (by @mbattista).
• Fixed sessions manager thread safety by adding mutexes (caused panic in rare edge cases).
• Now when user gets kicked, he won't join as a ghost user again but will be logged out.
• iOS compatibility! Fixed really strange CSS bug, which prevented iOS from loading the video.
• Proper disconnect only once with unsubscribing events. When webrtc fails, user won't be logged in without username again.

Misc

• Custom docker workflow.
• Based on debian buster instead of stretch.
• Versions bumped: Go 16, Node.js 14 (by @mbattista).
• Custom avatars without any 3rd party depenency.
• Ignore duplicate notify bars.
• No pointer events for notify bars.
• Disable debug mode by default.
• Remove HTML tags from user name.
• Upgraded pion/webrtc to v3 (by @mbattista).
• Added requestFullscreen compatibility for older browsersn and iOS devices.
• Fixed small lags in video and improved video UX (by @mbattista).
• Added m1k1o/neko:vncviewer tag, use NEKO_VNC_URL to specify VNC target and use n.eko as a bridge.
• Abiltiy to include neko as a component in another Vue.Js project (by @gbrian).
• Added HEALTHCHECK to Dockerfile.
• Arguments in broadcast pipeline are optional, not positional and can be repeated {url} {device} {display}.
• Chat messages are dense, when repeated, they are joined together.

Roadmap & TODOs

• Catch errors from gst pipeline, tell user if broadcast failed.

Getting started & FAQ

Use following docker images:

• m1k1o/neko:latest - for Firefox.
• m1k1o/neko:chromium - for Chromium (needs --cap-add=SYS_ADMIN).
• m1k1o/neko:ungoogled-chromium - for Ungoogled Chromium (needs --cap-add=SYS_ADMIN) (by @whalehub).
• m1k1o/neko:tor-browser - for Tor Browser.
• m1k1o/neko:vncviewer - for simple VNC viewer (specify NEKO_VNC_URL to your VNC target).
• m1k1o/neko:vlc - for VLC Video player (needs volume mounted to /media with local video files, or setting VLC_MEDIA=/media path).
• m1k1o/neko:xfce - for an shared desktop / installing shared software.
• m1k1o/neko:base - for custom base.

For ARM-based devices (like Raspberry Pi, with GPU hardware acceleration):

• m1k1o/neko:arm-firefox - for Firefox.
• m1k1o/neko:arm-chromium - for Chromium.
• m1k1o/neko:arm-base - for custom arm based.

Networking:

• If you want to use n.eko in external network, you can omit NEKO_NAT1TO1. It will automatically get your Public IP.
• If you want to use n.eko in internal network, set NEKO_NAT1TO1 to your local IP address (e.g. NEKO_NAT1TO1: 192.168.1.20)-

Why so many ports?

• WebRTC needs UDP ports for each channel it creates towards users.
• Every user will need 2 UDP ports (for getting audio/video and sending mouse positions).
• You can freely limit number of UDP ports. But you can't map them to diferent ports.
  • This WONT work: 32000-32100:52000-52100/udp
• You can change API port (8080).
  • This WILL work: 3000:8080

Behind reverse proxy?

• Nginx configuration: https://github.com/nurdism/neko/issues/111#issuecomment-742656957
• Apache configuration: cad98a62a5/docs/apache-proxypass-config.md (example-apache-config)
• Traefik configuration: a1b934515d/docker-compose.yml (L38-L43)

Want to use VPN for your neko browsing?

• Check this out: https://github.com/m1k1o/neko-vpn

Accounts:

• There are no accounts, display name (a.k.a. username) can be freely chosen. Only paword needs to match. Depeding on which password matches, visitor gets its privilege:
  • Anyone, who enters with NEKO_PASSWORD will be user.
  • Anyone, who enters with NEKO_PASSWORD_ADMIN will be admin.

Screen size

• Only admins can change screen size.
• You can set default screen size, but this size MUST be one from list, that your server supports.
• You will get this list in frontend, where you can choose from.

Firefox

version: "3.4"
services:
  neko:
    image: "m1k1o/neko:latest"
    restart: "unless-stopped"
    shm_size: "2gb"
    ports:
      - "8080:8080"
      - "52000-52100:52000-52100/udp"
    environment:
      NEKO_SCREEN: '1920x1080@30'
      NEKO_PASSWORD: neko
      NEKO_PASSWORD_ADMIN: admin
      NEKO_EPR: 52000-52100
      NEKO_NAT1TO1: <your-IP>

Chromium

version: "3.4"
services:
  neko:
    image: "m1k1o/neko:chromium"
    restart: "unless-stopped"
    shm_size: "2gb"
    ports:
      - "8080:8080"
      - "52000-52100:52000-52100/udp"
    cap_add:
      - SYS_ADMIN
    environment:
      NEKO_SCREEN: '1920x1080@30'
      NEKO_PASSWORD: neko
      NEKO_PASSWORD_ADMIN: admin
      NEKO_EPR: 52000-52100
      NEKO_NAT1TO1: <your-IP>

VLC

version: "3.4"
services:
  neko:
    image: "m1k1o/neko:vlc"
    restart: "unless-stopped"
    shm_size: "2gb"
    volumes:
      - "<your-video-folder>:/video" 
    ports:
      - "8080:8080"
      - "52000-52100:52000-52100/udp"
    cap_add:
      - SYS_ADMIN
    environment:
      NEKO_SCREEN: '1920x1080@30'
      NEKO_PASSWORD: neko
      NEKO_PASSWORD_ADMIN: admin
      NEKO_EPR: 52000-52100
      NEKO_NAT1TO1: <your-IP>

Raspberry Pi

Note! Since this pipeline is using H264, that enables GPU HW acceleration for Raspberry Pi, you are only able to connect from browsers supporting H264 for WebRTC. At the time of implementing, Firefox does not support this.

version: "3.4"
services:
  neko:
    image: "m1k1o/neko:arm-chromium"
    restart: "unless-stopped"
    # increase on rpi's with more then 1gb ram.
    shm_size: "520mb"
    ports:
      - "8088:8080"
      - "52000-52100:52000-52100/udp"
    # this is important since we need a GPU for hardware acceleration alternatively mount the devices into the docker.
    privileged: true
    environment:
      NEKO_SCREEN: '1280x720@30'
      NEKO_PASSWORD: 'neko'
      NEKO_PASSWORD_ADMIN: 'admin'
      NEKO_EPR: 52000-52100
      # optional: change target bitrate and framerate on this parameter.
      NEKO_VIDEO: |
        ximagesrc display-name=%s use-damage=0 show-pointer=true use-damage=false
          ! video/x-raw,framerate=30/1
          ! videoconvert
          ! queue
          ! video/x-raw,framerate=30/1,format=NV12
          ! v4l2h264enc extra-controls="controls,h264_profile=0,video_bitrate=1250000;"
          ! h264parse config-interval=3
          ! video/x-h264,profile=baseline,stream-format=byte-stream        

Mobile support

Neko is now working on iOS and Android! Also, the UI screens have been fixed for small screens.

Docker-Compose Enviroment Options

NEKO_SCREEN:
  - Resolution after startup. Only Admins can change this later.
  - e.g. '1920x1080@30'
NEKO_PASSWORD:
  - Password for the user login
  - e.g. 'user_password'
NEKO_PASSWORD_ADMIN
  - Password for the admin login
  - e.g. 'admin_password'
NEKO_EPR:
  - For WebRTC needed range of ports
  - e.g. 52000-52100
NEKO_VP8:
  - If vp8 should be used as video encoder for the stream (default encoder)
  - e.g. 'true'
NEKO_VP9:
  - If vp9 should be used as video encoder for the stream (Parameter not optimized yet)
  - e.g. 'false'
NEKO_H264:
  - If h264 should be used as video encoder for the stream (second best option)
  - e.g. 'false'
NEKO_VIDEO_BITRATE:
  - Bitrate of the video stream in kb/s
  - e.g. 3500
NEKO_VIDEO:
  - Makes it possible to create custom gstreamer pipelines. With this you could find the best quality for your CPU
  - Installed are gstreamer1.0-plugins-base /  gstreamer1.0-plugins-good /  gstreamer1.0-plugins-bad /  gstreamer1.0-plugins-ugly
  - e.g. ' ximagesrc display-name=%s show-pointer=true use-damage=false ! video/x-raw,framerate=30/1 ! videoconvert ! queue ! video/x-raw,format=NV12 ! x264enc threads=4 bitrate=3500 key-int-max=60 vbv-buf-capacity=4000 byte-stream=true tune=zerolatency speed-preset=veryfast ! video/x-h264,stream-format=byte-stream '
NEKO_MAX_FPS:
  - The resulting stream frames per seconds should be capped (0 for uncapped)
  - e.g. 0
NEKO_OPUS:
  - If opus should be used as audio encoder for the stream (default encoder)
  - e.g. 'true'
NEKO_G722:
  - If g722 should be used as audio encoder for the stream
  - e.g. 'false'
NEKO_PCMU:
  - If pcmu should be used as audio encoder for the stream
  - e.g. 'false'
NEKO_PCMA:
  - If pcma should be used as audio encoder for the stream
  - e.g. 'false'
NEKO_AUDIO_BITRATE:
  - Bitrate of the audio stream in kb/s
  - e.g. 196
NEKO_CERT:
  - Path to the SSL-Certificate
  - e.g. '/certs/cert.pem'
NEKO_KEY:
  - Path to the SSL-Certificate private key
  - e.g. '/certs/key.pem'
NEKO_ICELITE:
  - Use the ice lite protocol
  - e.g. false
NEKO_ICESERVER:
  - Describes a single STUN and TURN server that can be used by the ICEAgent to establish a connection with a peer (simple usage for server without authentication)
  - e.g. 'stun:stun.l.google.com:19302'
NEKO_ICESERVERS:
  - Describes multiple STUN and TURN server that can be used by the ICEAgent to establish a connection with a peer
  - e.g. '[{"urls": ["turn:turn.example.com:19302", "stun:stun.example.com:19302"], "username": "name", "credential": "password"}, {"urls": ["stun:stun.example2.com:19302"]}]'
  - [More information](https://developer.mozilla.org/en-US/docs/Web/API/RTCIceServer)

How to contribute?

Navigate to .m1k1o/README.md for further information.