--- Log opened Mon Mar 14 00:00:32 2011
06:56 < mcallan> conseo: ping
06:56 < mcallan> thomasvonderelbe: i'm thinking we might be able to help out Matt Baca: http://groups.google.com/group/sunlightlabs/t/61823fdf7ba1a88d
06:59 < thomasvonderelbe> mcallan: interesting, I have a look
07:06 < mcallan> thomasvonderelbe: i'm replying to your message in the V list. can we skype briefly? here's more about Matt's thing: http://lexpop.org/index.php?title=About
07:07 < thomasvonderelbe> sure, now?
07:07 < mcallan> i checked his wiki, we can work with it.
07:07 < mcallan> ok, i'll turn on my skype box
07:12 < thomasvonderelbe> ok
08:09 < mcallan> thomasvonderelbe: (we're on skype) here's the url: http://piratepad.net/XnhXCQTerT
11:16 < conseo> mcallan: pong
11:22 < conseo> thomasvonderelbe: pong
11:29 < mcallan> hey c, thomas and i are skyping
11:29 < conseo> ok
11:33 < conseo> can i join?
11:48 < mcallan> conseo: sorry, i was in the other room. we just wrapped up.
11:49 < conseo> :-(
11:49 < conseo> :-)
14:35 < conseo> mcallan: re
16:10 < mcallan> conseo: i decided to join u running. and i'm still tied up for another 30m or so
16:43 < mcallan> conseo: back now
16:57 < conseo> mcallan: ok
19:28 < mcallan> conseo: if it's not hard, can you support this pattern of diff URL too: http://u.zelea.com:8080/v/w/Diff?b=4044&a=4047&aR=2720&bR=2721
19:28 < conseo> i do, don't i?
19:29 < mcallan> i don't know
19:29 < conseo> mcallan: i parse a, b, aR and bR, where aR and bR are set to -1 when they are not available
19:29 < conseo> as being parsed by DraftPair
19:29 < conseo> i had a look at that code
19:29 < conseo> and it says that if  aR and bR are not empty then the draft is elsewhere, right?
19:31 < mcallan> right, if aR non-empty, then a-draft is remote
19:31 < mcallan> same for b-draft
19:32 < mcallan> conseo: so voharvester will take this? http://u.zelea.com:8080/v/w/BlahDeeDahDeeDoo?b=4044&a=4047&aR=2720&bR=2721
19:33 < conseo> ah what you mean ist that i should only look for http://u.zelea.com:8080/v/w and then try to parse the parameters to allow other services as well?
19:35 < mcallan> no. it currently harvests this, right? http://u.zelea.com:8080/v/w/D?b=4044&a=4047&aR=2720&bR=2721
19:35 < conseo> yep
19:35 < mcallan> will it also harvest this? and do you see the difference between the two? http://u.zelea.com:8080/v/w/Diff?b=4044&a=4047&aR=2720&bR=2721
19:36 < conseo> i do, but why do you need these two?
19:37 < mcallan> all the URLs from last year use the longer page name, and they are in the mail archive
19:37 < mcallan> we support both
19:38 < conseo> it should do so already
19:38 < conseo> when you set the diff-url schema in voharvester.conf to http://u.zelea.com:8080/v/w/D you should be done
19:39 < conseo> and since that is that way already, you should even be able to simply drop them in the box
19:39 < conseo> i hope it works
19:39 < conseo> i am writing some code to allow the harvester to update messages with a new flag
19:40 < conseo> you can then directly operate on the mailbox (e.g. filter with procmail) if you are only interested in specific discussions or need to edit some mails for the db
19:42 < mcallan> yes, you're right: FINER: Matched diff-URL: http://u.zelea.com:8080/v/w/Diff?b=4044&a=4047&aR=2720&bR=2721
19:43 < conseo> FINEST :-D
19:44 < mcallan> :) would be if it didn't match: http://u.zelea.com:8080/v/w/DiddlyDiddlyDoo?b=4044&a=4047&aR=2720&bR=2721
19:44 < mcallan> (just kidding)
19:44 < mcallan> it's almost impossible it'll grok the wrong URL
19:46 < conseo> :-)
19:48 < mcallan> i'm going to pull now, and get your latest code running. What do you mean "update messages"?
19:49 < conseo> it uses SQL update set ... on the message as your code does elsewhere
19:49 < conseo> so if the message is sent from the same author on the same date then it will be changed instead of inserted
19:49 < mcallan> so you can overwrite, no errors. OK.
19:53 < conseo> makes that sense? because u have said i could drop them in files, but then handling a mailboxes might be more straightforward to manage the db. it doesn't work for irc though (where putting every message in a file would)
19:54 < conseo> you can update the db though
19:57 < mcallan> i don't know. but it means i can drop in all the old start messages stored in my mutt, and i don't have to worry about it choking if it's already got some of them.
19:57 < mcallan> so i'm happy so far. :-)
19:59 < mcallan> should use hg mv, not just mv. tsk tsk. ;)
20:06 < mcallan> conseo: u have this:
20:06 < mcallan> -        defaultBaseLayer: 'Google Satellite',
20:06 < mcallan> +        defaultBaseLayer: 'Osmarender OSM',
20:07 < mcallan> but satellite looks better, imho
20:09 < conseo> i think the osmarender looks cooler. the sattelite seem dumb to me. but i don't care too much atm.
20:19 < mcallan> conseo: i have: WARNING: 
20:19 < mcallan> java.lang.NullPointerException at votorola.a.crossforum.ss.BiteJig.parsedDate(BiteJig.java:156) at votorola.a.crossforum.ss.BiteJig.serialize(BiteJig.java:169) at votorola.a.crossforum.dum.DummyFeedSS.doGet(DummyFeedSS.java:143) at javax.servlet.http.HttpServlet.service(Unknown Source) at javax.servlet.http.HttpServlet.service(Unknown Source)
20:24 < mcallan> conseo: and when i switch from dummy to diff feed:
20:24 < mcallan> 14-Mar-2011 8:24:20 PM votorola.a.crossforum.diff.DiffFeedSS doGet
20:24 < mcallan> FINE: request from 127.0.0.1: form=json&since=0&callback=__gwt_jsonp__.I0.onSuccess
20:24 < mcallan> 14-Mar-2011 8:24:20 PM votorola.a.diff.feed.DiffMessageTable get
20:24 < mcallan> SEVERE: SELECT title,author,addressee,url,poll,pos_url,summary,diff_url,sent_ts,parsed_ts FROM "feed"."diff_messages" where parsed_ts > 1969-12-31 19:00:00.000000 -05:00:00 order by sent_ts 
20:26 < conseo> the last statment is leftover from my db testing code, sry
20:26 < conseo> nothing wrong here
20:27 < conseo> i haven't really touched DummyFeedSS, maybe you have changed sth. when you fixed it? i can have a look though, but it doesn't talk to my db or my bites
20:32 < mcallan> conseo: it's a bug in BiteJig, you have a null field parsedDate.
20:32 < conseo> ok, sry, i'll fix it if u need me to
20:35 < mcallan> best fix is maybe to use long, not Date. let client wrap it as Date, if he wants to. The feeds must be fast, and should not be creating thousands of Dates.
20:36 < mcallan> conseo: no hurry for fix. i'll pull whenever your ready.
20:37 < mcallan> 2 other minor things: votorola/a/crossforum/diff/DiffFeed.java has a System.out.print statement
20:38 < mcallan> 2) and since the geomapper is my maintain, please revert votorola/a/web/base/crossforum/config.js till we talk. ok?
20:40 < conseo>  sure, no problem
20:42 < conseo> i'll fix them too
20:42 < conseo> cu
20:44 < mcallan> thanks c, cu
--- Log closed Tue Mar 15 00:00:47 2011