Comments on: Jobs (2 kinds) http://leahculver.com/2007/10/12/jobs-2-kinds/ leahculver.com Tue, 06 Jan 2009 07:06:09 +0000 http://wordpress.org/?v=2.3.2 By: Brian Aker http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-851 Brian Aker Fri, 19 Oct 2007 19:32:47 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-851 Hi! Ask Blaine of Twitter. They were using Innodb under MySQL for quite some time, and then they moved to some sort of memcached hacked up server (which they have not open sourced). There are some attempts to come up with a queue engine for MySQL, but at the moment I would just stick with Innodb. Cheers, -Brian Hi!

Ask Blaine of Twitter. They were using Innodb under MySQL for quite some time, and then they moved to some sort of memcached hacked up server (which they have not open sourced). There are some attempts to come up with a queue engine for MySQL, but at the moment I would just stick with Innodb.

Cheers,
-Brian

]]> By: Chris Milton http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-848 Chris Milton Tue, 16 Oct 2007 23:49:56 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-848 My previous comment is still awaiting moderation, but that Django Queue Service looks cool. My previous comment is still awaiting moderation, but that Django Queue Service looks cool.

]]> By: Mason http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-847 Mason Tue, 16 Oct 2007 06:05:07 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-847 Looks promising: http://code.google.com/p/django-queue-service/ Pax, M Looks promising:

http://code.google.com/p/django-queue-service/

Pax,
M

]]> By: john http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-846 john Mon, 15 Oct 2007 06:13:00 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-846 an open source queuing system for database processes? i'd offer a suggestion, but i have no idea wtf that is. and from the other comments, it sounds like the others don't either. an open source queuing system for database processes? i’d offer a suggestion, but i have no idea wtf that is. and from the other comments, it sounds like the others don’t either.

]]> By: Cam http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-845 Cam Sun, 14 Oct 2007 12:49:29 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-845 Can't tell from the post: Are you looking for a message queue, or something to queue batch processes? Can’t tell from the post: Are you looking for a message queue, or something to queue batch processes?

]]> By: Chris Milton http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-843 Chris Milton Sat, 13 Oct 2007 05:41:48 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-843 I could probably write a daemon in Perl with something like Queue::Dir [ http://search.cpan.org/~luismunoz/Queue-Dir-0.01/ ]. I could probably write a daemon in Perl with something like Queue::Dir [ http://search.cpan.org/~luismunoz/Queue-Dir-0.01/ ].

]]> By: Alex http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-842 Alex Fri, 12 Oct 2007 19:10:17 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-842 Have you considered Amazon SQS ? Since you're using S3 already it would seem like a good fit. I'd be interested in your thoughts on Amazon SQS and other queuing systems once you've made a decision. Have you considered Amazon SQS ? Since you’re using S3 already it would seem like a good fit. I’d be interested in your thoughts on Amazon SQS and other queuing systems once you’ve made a decision.

]]> By: Dion Almaer http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-841 Dion Almaer Fri, 12 Oct 2007 18:16:07 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-841 Yah check out ActiveMQ and Stomp. Python-y help is available: http://stomp.codehaus.org/Python Yah check out ActiveMQ and Stomp. Python-y help is available: http://stomp.codehaus.org/Python

]]> By: Matt Erkkila http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-840 Matt Erkkila Fri, 12 Oct 2007 16:53:07 +0000 http://leahculver.com/2007/10/12/jobs-2-kinds/#comment-840 Take a look at Active MQ. It is a JMS based queue/messaging system that you can use to manage and process any type of message, be it database, email, etc. It has great redundancy and load balancing features and is a apache project so it has a great user base. The system itself is java (it has all sorts of libraries to access it, even python) so it can be a resource hog and sometimes hard to configure but once you get it working it works well. Hope this helps. Take a look at Active MQ. It is a JMS based queue/messaging system that you can use to manage and process any type of message, be it database, email, etc. It has great redundancy and load balancing features and is a apache project so it has a great user base. The system itself is java (it has all sorts of libraries to access it, even python) so it can be a resource hog and sometimes hard to configure but once you get it working it works well. Hope this helps.

]]>