1w ago

Docker Hub limiting unauthenticated users to 10 pulls per hour

Learn about usage and limits for Docker Hub.

AFAIK every NAS just uses unauthenticated connections to pull containers, I'm not sure how many actually allow you to log in even (raising the limit to a whopping 40 per hour).

So hopefully systems like /r/unRAID handle the throttling gracefully when clicking "update all".

Anyone have ideas on how to set up a local docker hub proxy to keep the most common containers on-site instead of hitting docker hub every time?

Technology @lemmy.world

nahostdeutschland @feddit.org

1w ago

Docker limits unauthenticated pulls to 10/hour/IP from Docker Hub, from March 1

docs.docker.com /docker-hub/usage/

71 9

You're viewing a single thread.

48 comments

Huh. I was just considering establishing a caching registry for other reasons. Ferb, I know what we’re going to do today!
- Do you have a good resource for how one can go about this?
  
  I’ve only done my “is it even possible” research so far, but these look promising:
  https://medium.com/@amandubey_6607/docker-registry-caching-a2dfefecfff5
  https://github.com/obeone/multi-registry-cache
  
  https://www.squid-cache.org/ Should work too I think
  
  Much appreciated <3
  
  You can host your own with harbor, and set up replication per repo (pull upstream tags) If you need a commercial product/support you can use MSR v4.
  Harbor can install on any K8s cluster using helm, with just a couple of dependencies (cert-manager, postgres op, redis-op) Replication stuff you can easily add.
  I have some no-warranty terraform I could share if there is some interest.
  
  That's what we do internally for our openshift deployment. It will reach out if not in harbor and then cache it there for everyone else to use.
- Same here. I've been building a bootstrap script, and each time I test it, it tears down the whole cluster and starts from scratch, pulling all of the images again. Every time I hit the Docker pull limit after 10 - 12 hours of work, I treat that as my "that's enough work for today" signal. I'm going to need to set up a caching system ASAP or the hours I work on this project are about to suddenly get a lot shorter.

48 comments