Hell Oh World!

git branching awesomeness

2009-11-14T14:39:12Z

Branching in cvs was always a bit of a black art to me. I always had to plan in advance, think twice and generally breathe heavily before I attempted to create a branch. The workflow would be

Check out a fresh copy of the code
cvs tag -b mybranch

And then continue using that copy for your branch-specific changes. So the tag was the branch... or something like that. Anyway, you maintain a different tree for your HEAD too and will have to generally go through a lot of pain to merge patches from HEAD to branch or vice versa.

Now here's how you branch in git:

git branch mybranch

Yes, that is it. You have created a branch. Congratulations! Oh ok, you want to work on it?

git checkout mybranch

Do your foo and generally have fun with that branch. Oops, look! A patch that needs to go into HEAD:

git checkout master

And go ahead and apply your patch into HEAD. Time to push all the stuff into your public repository?

git push --all

And watch everything, including your branch changes get pushed seamlessly.

I'll say it again, this is one tool that seriously fits me like a glove. Simply awesome! The one thing left is now the merge back of the branches. I won't get there for another few weeks I guess, but from the docs, it seems as simple as:

git merge mybranch

Sweet!

Update

I just did a merge now to see what git can do. I made some changes in master and decided to merge those changes into my new xmpp branch just for kicks. I have to admit that the merge did not have any conflicts, but here's how it went:

[siddhesh@spoyarek ayttm]$ git checkout xmpp
Switched to branch 'xmpp'
[siddhesh@spoyarek ayttm]$ git merge master
Merge made by recursive.
 libproxy/proxy.c                         |   41 ++++++++----------------------
 modules/aim-oscar/aim-oscar.c            |    7 +---
 modules/aycryption/select-keys.c         |    2 +-
 modules/importers/import_gnomeicu.c      |    1 -
 modules/importers/importicq.c            |    4 +--
 modules/importers/importlicq.c           |    1 -
 modules/irc/irc.c                        |   12 ++++----
 modules/irc/libirc/irc_message.c         |    4 +-
 modules/irc/libirc/libirc.c              |   10 +++---
 modules/irc/libirc/libirc.h              |    2 -
 modules/utility/autotrans.c              |    4 +-
 modules/utility/rainbow.c                |    4 +-
 modules/yahoo2/libyahoo2/libyahoo2.c     |    4 +--
 modules/yahoo2/libyahoo2/yahoo_httplib.c |    2 +-
 modules/yahoo2/yahoo.c                   |   16 +----------
 src/add_contact_window.c                 |    6 +++-
 src/edit_local_accounts.c                |    4 +-
 src/file_select.c                        |    1 -
 src/main.c                               |    4 +--
 src/message_parse.c                      |    3 --
 src/service.c                            |    2 +-
 src/smileys.c                            |    2 +-
 src/smileys.h                            |   12 ++++----
 src/sound.c                              |    6 +++-
 src/speech.c                             |    2 +-
 src/status.c                             |    5 ---
 src/trigger.c                            |    3 --
 27 files changed, 56 insertions(+), 108 deletions(-)

Yes, that is all! Here are the results of the merge. And here is the master branch

Ayttm 0.6.1 — The work starts now

2009-10-30T13:57:41Z

Just did an ayttm release. This is to lay groundwork for xmpp rewrite, which Piotr will be doing after I lay down the framework. The idea is to make a clean and light xmpp framework and then have even lighter plugins on top of it for gtalk, jabber, etc. Usability and extensibility FTW!

Ayttm Workout proposal at FOSS.in/2009

2009-10-21T10:51:26Z

I just submitted an ayttm workout proposal for FOSS.IN/2009. Hopefully it will get accepted this time and we get some real work done. I want to get a 0.6.1 and 0.6.2 out before the event begins so that there is a nice clean base for people to work on.

I hope the workout gets accepted.

I hope we get worthwhile contributions.

I hope they have the cold caffeine too this time :D

Free food ftw!

Who the hell invented the blink tag?

2009-10-10T08:03:06Z

Look what your invention has done to the interweb :(

Getting a little loud

2009-10-04T19:13:44Z

Me and me missus settled down to watch a movie (300) yesterday only to realize that the volume of the movie was considerably low. All controls on alsa mixer were jacked up to full and it wasn't related to any of the default volume level bugs; I had done an alsamixer -c0 to jack up the volume levels. I have only one audio card.

I searched on the interwebs for a software mixer program that could give me something a little more audible, no matter even if it was slightly screechy. I found nothing worthwhile and was about to give up. Then on a whim I opened up the movie on mplayer instead of the default totem (I rarely need to do that I must say) and started looking at what I could jack up there. Lo and behold, there was a slider in Preferences > Audio tab called Stereo boost (or something like that; it's on the other laptop and I'm too lazy to look it up now), which worked for me. I turned it all the way up and was finally able to understand the dialogue. It's a different thing that the movie turned out to be mostly about people cutting up other people (of course, that was fun too ;) ) so my efforts were worthwhile only for the first few minutes of the movie.

That said, this does not work for all kinds of movies since it seems to turn up the volume only on a specific channel. Due to this, on another movie, the dialogue was drowned out by traffic noise due to this stereo boost being jacked all the way up. Anyway, the point of the post was to say that there is in fact a way to (sort of) amplify sound in software.

Also, it looks like alsa does not quite seem to give the same kind of output that the audio subsystem on windows would give. Maybe this is specific only to certain types of cards.

git FTW!

2009-09-25T20:48:11Z

I started using git with ayttm only a week ago and I'm loving it already. I love the fact that I can commit multiple fixes to my repository and then push them out all together with a single command. Everything remains well sorted out without me having to break my flow to commit changes into the central repository. It's either that or committing a huge chunk of code, and I would regularly choose the latter.

The central repository on SF was a bit difficult to set up especially since it was my first time with git and there was a lot I needed to learn about the system. Add to it the pain of migrating the cvs repository contents to git. But once I figured out the stuff, it all seemed to fit in so beautifully. I know I've only scratched the surface of its power but it just feels good to use. Few programs have given me this wow! feeling since some time now. I guess it's all about individual preference though.

Moving Ayttm to git

2009-09-19T11:40:22Z

I am importing the ayttm cvs repository to git as I write this. This was something I had thought of earlier, but never had any motivation to do so since things just worked without it anyway. It was Kushal who made the suggestion to me, saying that it would be easier for the Fedora guys to keep in sync with development upstream. I take it from this that the Fedora community will contribute some code to ayttm in the future, which I will be able to pull in easily in the future.

Size does matter

2009-09-15T16:18:56Z

The packages we released for ayttm 0.6.0 were around 1.52 MB with bzip2 compression. The guys at puppy Linux built ayttm optimized for size and they were able to reduce the package size to half with it! Here's the forum post for those interested.

The journey so far, and ahead

2009-09-14T17:41:00Z

The last six months have been quite big for ayttm, and for me too. We did on last Friday, what was probably our biggest release in ayttm. Well, it's a bit subjective I guess, because I felt that way even when I did the gtk2 port release. And the IRC release. But this one was really big. Check out the release notes and you'll know. When asked about ayttm a few months ago, I had said to Sankarshan that I would be done with yahoo and msn support by next year. I'm really happy that we've managed to get it done way before time. There is yet another goal I had mentioned to him then — making ayttm stable.

We're still not as stable as we'd like to be. There was one completely random crash that Minto (package maintainer for Fedora) came across and showed me at work today. We were not able to reproduce it the second time. We need to iron out these things. My next focus is going to be the chat window/room stuff. The code is almost completely duplicated, so I'm going to make something uniform out of it, focussing more on separating the UI from the core. This will hopefully result in much cleaner code.

Once this is done, the ugly xpm smileys will have to go. I'm thinking of using a subset of the protocol smileys instead, especially the PNGs on the website. The website needs a lot of updating too. Kartik has volunteered to do the online manual and the new screenshots when he has time, so that should be done pretty soon.

There are a few people at work who are wondering if we would do voice support. Maybe.

Ayttm progress

2009-08-24T12:30:44Z

Right now, the cvs version of ayttm looks pretty good. We've been able to get in YMSG16 support, MSNP15 support and a lot of fixes in the GUI and jabber. I finally got rid of the custom dialogs code in ayttm and Piotr has done a lot of work with the state/status messages. The netv2 code also seems to be looking quite good since nothing seems to be breaking in it of late.

There are a few filler functions that remain to be implemented in MSN so that it does not crash. Also, both yahoo and msn need file transfer and invitations -- I am not done with that either. I have been threatening to do a release for some time now, so I might just act out that threat in the coming weeks. So these are busy days.

Ayttm updates

2009-07-11T12:13:38Z

First goal of getting yahoo working on YMSG16 is done. Read more about it in the ayttm journal. Roadmap for yahoo support is now:

Fix the little things
File Transfer

That will come in later. Most likely once netv2 merges into trunk. Now I will be shifting focus to MSN and other tiny protocols (livejournal, smtp, etc.) on netv2.

Sweating it out on YMSG16

2009-07-02T14:05:51Z

I finally finished writing a working implementation of the YMSG16 authentication as described in this article. The authentication seems to be working quite well, but nothing else does. The server still does not respond to the older binary type messages. So the next thing I tried was to wireshark the windows based yahoo messenger ( my employer provided the windows box for me :D ) and I found out two things:

The Authentication probably is what is described in the carbonize site, but there looks to be a different way to get the initial challenge string
All messages go to and from one server in the form of HTTP POST and responses

There some more cookies involved as well, which is what Adrian was probably talking about in the comment to my previous post. Thankfully, since ayttm is on YMSG12, we are still online unlike pidgin, so no need to rush in a fix for this just yet. That said, the popup says I have until August 15th till YMSG12 dies too. I need to see how pidgin has fixed this. Maybe the fix is much simpler than revamping everything to do what the windows YMSGR is doing.

Update: I was wrong. I sent the wrong message to the server after authentication — forgot to add the challenge digest, which is why it barfed on me. Work is on now for stuff after the auth :)

What do we need for YMSG15?

2009-06-18T19:42:47Z

Ayttm needs to go on to YMSG15. So I decided to do a small test to see what could break if we just change the protocol version sent to Yahoo. So I advanced the protocol version from 0x00000c to 0x00000f in libyahoo2. Also, I enabled debugging in libyahoo2 so that it could dump packets that it did not recognize. Here's my brain dump of the little experiment:

Some packet numbered as 0xef. Don't know what that is
File transfer will change, as I had seen from the last time I had fixed file transfer for YMSG12
Gennady Feldman had added some service codes into the libyahoo2 for YMSG13, which seem to be coming in due to the move to YMSG15. The 0xf0 and 0xf1 above are a result of that. Also, messages to rename groups and move contacts between groups seem to have changed
I got a 0xf0 message, which seems to be a list of buddy statuses, including mine
A 0xf1 message, which seems to be the complete list of buddies. So I don't really need to fetch them from cab.yahoo.com, do I?
Another thing that seems changed but did not affect me this time around seems to be the login procedure. I'm planning to move to YMSG16 for that since I have more complete information on how it can be implemented.
To get YMSG16, I need SSL. To get SSL, I need to update libyahoo2 to move to netv2. So obviously this needs to go into the netv2 branch

netv2 does not seem to be ready just yet, Philip had problems getting gmail to work with netv2. There's a bit of tightrope walking with multiple threads and SSL. Hopefully I can figure out what the deal is since almost everything is starting to use SSL. Does anyone want to get their hands dirty on netv2?

But couldn't I just open up libpurple and get that stuff in? Yes, but it won't be fun enough would it? :)

[Solved (I think)] MSEB Online Payment

2009-04-28T14:06:19Z

Finally! Here's how I went about it:

First, I wrote a simple program that downloads a page from http://billing.mahadiscom.in

#include <sys/types.h>
#include <sys/socket.h>
#include <netdb.h>
#include <stdio.h>
#include <stdlib.h>
#include <unistd.h>
#include <string.h>

#define BUF_SIZE 2048

int main(int argc, char *argv[])
{
	char *host="billing.mahadiscom.in";
	char *port="80";

	int n=0, iter=0;

	struct addrinfo hints;
	struct addrinfo *result, *rp;
	int sfd, s;
	char buf[BUF_SIZE];

	memset(&hints, 0, sizeof(struct addrinfo));
	hints.ai_family = AF_INET;
	hints.ai_socktype = SOCK_STREAM;
	hints.ai_flags = 0;
	hints.ai_protocol = 0;

	s = getaddrinfo(host, port, &hints, &result);
	if (s != 0) {
		fprintf(stderr, "getaddrinfo: %s\n", gai_strerror(s));
		exit(EXIT_FAILURE);
	}


	for (rp = result; rp != NULL; rp = rp->ai_next) {
		sfd = socket(rp->ai_family, rp->ai_socktype, rp->ai_protocol);
		if (sfd == -1)
			continue;

		if (connect(sfd, rp->ai_addr, rp->ai_addrlen) != -1)
			break;	/* Success */
		else
			perror("connect");

		close(sfd);
	}

	if (rp == NULL) {	/* No address succeeded */
		fprintf(stderr, "Could not connect\n");
		exit(EXIT_FAILURE);
	}

	freeaddrinfo(result);	/* No longer needed */

	if(write(sfd, "GET /billinfo.php HTTP/1.1\r\n", 
			strlen("GET /billinfo.php HTTP/1.1\r\n") ) < 0 )
		perror("write1");

	if (write(sfd, "Host: billing.mahadiscom.in\r\n", 
			strlen("Host: billing.mahadiscom.in\r\n") )<0)
		perror("write2");

	if(write(sfd, "\r\n", strlen("\r\n") )<0)
		perror("write3");

	memset(buf, 0, BUF_SIZE);

	while((n = read(sfd, buf, BUF_SIZE-1)) >0) {
		printf("%s\n\n==========================\n\n"
			"%d bytes received (Iter %d)\n\n"
			"===============================\n\n", 
			buf, n, ++iter);
		memset(buf, 0, BUF_SIZE);
	}

	if (n<0)
		perror("error");

	return 0;
}

On first run, data came in at 1448 bytes per burst and then hung up in about 3 bursts. Then I connected to the UK based VPN and tried again. This time data came in at 1360 bytes per burst and the entire page got downloaded. I discussed this with Ranjith Rajaram at work and he told me about MTU, which affects this window size.

Sure enough, tun0 was configured with an MTU of 1412 while eth0 had an MTU of 1500. I modified the MTU for eth0 and presto! It worked! I'm still wondering how this works for Windows systems without any such interference.

PS: Yes, the code's really dirty... but that's not the point.

Suspicious site?

2009-04-20T09:47:04Z

Firefox (or is it google?) seems to think that ceo.maharashtra.gov.in is a suspicious site. It apparently hosts malicious software which gets installed without user content.

The site runs on Linux, so surely it couldn't be ActiveX stuff right? Or maybe google going bonkers.

Update: Someone pointed out that I'm an idiot and I need to double-check facts before I post. I agree with him/her.

Gnome Terminal --tab

2009-04-14T18:27:20Z

So I wrote my first upstream patch for something that is not ayttm ;) Let's see if it gets accepted though -- the issue has been rotting for seven years now.

Online Payment on Mahadiscom and SBI card

2009-03-31T04:44:38Z

The MSEB billing site opens only when I access it from a UK based proxy. It does not work when I access it from home -- be it from my Airtel connection or from Sify. The same was true for SBI card today, although it is normally accessible from home; unlike MSEB, where I have been trying to pay my bills online unsuccessfully for months before I stumbled on to a UK proxy.

Well fed -- RSS Feeds

2009-03-10T17:22:27Z

My web host finally got its act together after telling me that RSS feeds not showing up on my website were a programming fault and opened up outgoing connections from my site to my journal. They were quite active in following up -- they even called back when my call got dropped. Quite nice.

Yes, I'll stop with my silly sense of humour now.

The making of libnet? libaynet? libnetwork?

2009-03-09T18:27:10Z

I was finally able to commit what I started thinking about and working on during FOSS.in back in November last year. Ayttm now starts its connections in a different thread. This eliminates the hang-ups that one may experience when the application is looking up a hostname. The proxy code was also not really with it. I wonder if anyone has tested to see if it works in the first place. For that matter, after I'm done with it, I hope someone tests it as well ;)

So here's what I did. Every time a connection is requested, The connector creates a gthread for the connection and then adds an idle function source (see g_idle_add() in glib) to see if that connection has completed or not. once the connection thread returns, the idle handler continues and calls the connection callback, thus returning control to the connection requestor.

Like that made a lot of sense ;)

The bigger goal is to make this into a more serious networking wrapper library. Next step now is to add SSL support into the library. Then instead of linking it statically, I wonder if it would be a good idea to make it a separate module altogether. It might be necessary since nothing in the core uses SSL, so statically linking libproxy into the core won't work at all.

Oh, and the name libproxy just doesn't cut it anymore. I guess it should be called libnet or something once I'm through with it :)

Starving -- RSS Feeds

2009-03-06T19:40:10Z

I finally shelled out some money for web hosting and I already feel like I've wasted it. My web hosts seem to have outgoing connections blocked, due to which this journal feed is still not visible on the site.

I looked around and figured that I could do the RSS in JavaScript as well. Should have looked harder before I shelled out 2500 Rs :(

First commit from work...

2009-02-13T19:27:24Z

Yes, I can now work on ayttm at my workplace as well. I joined Red Hat last month :D

I had to replace gtk_tool_item_set_tooltips() function in various places since it is broken in the latest libgtk. Anyways, it has been deprecated since some time now, so no harm in that. The only big effect is that I had to bump up required gtk version to 2.12.

Anyways, once I get my bearings right at work, I should be able to contribute more regularly :)

Also, we need to push ayttm into Fedora.

FOSS.in

2008-11-28T14:38:35Z

A great event to go to if you want to know exactly how many and how much Indians are contributing to FOSS. Major contribution seems to be coming on the KDE and the Linux kernel front.

Workouts must have been great -- didn't get a chance (nor was I adequately prepared) to go to any of them since I was busy with my own little workout -- trying to get asynchronous connection going on ayttm. It's almost working now, except for SSL stuff. It has nothing to do with connection management really. It has something to do with threads, callbacks and the main loop. If you look into the implementation of eb_do_no_callback_dialog () and imagine it to be in a different thread than that in the main loop, you'll have an idea of what I'm talking about. I hope I'll have it fixed before I leave for Mumbai on Monday.

Oh, and met Philip for the first time in person. We had an ayttm BoF session today, in which I struggled with the SSL stuff and Philip and Pradeep tried to get ayttm to compile on Pradeep's laptop.

@FOSS.in

2008-11-25T08:49:27Z

I'm at FOSS.in right now, listening to Rahul Bhalerao and hacking at ayttm till my laptop charge lasts (which is another 40 minutes now... must learn to conserve better).

Right now I'm trying to do fully asynchronous connects for ayttm. Currently, DNS lookups are synchronous and will hang up whenever there's no network and no cached DNS. It's worse with proxy -- the whole thing is synchronous.

Lenovo 3000 G410

2008-10-30T17:42:06Z

That's my new weapon, which I've finally got working amidst the usual Diwali fever; shuttling between Kharghar and Mira Road and generally trying to get my home in shape for our first Diwali. Anyways, on to the weapon in question:

Processor: Intel Dual core 1.86 GHz
Memory: 2 GB
HDD: 160 GB
Network: Ethernet, Wireless, Bluetooth
Looks: Boxy, the kind most think looks ugly. Works for me though as long as it does what I want it to do.

The entire package cost only 29000 INR from Croma and I slapped on 999 INR for an HP PSC. A discount on being a Tata employee meant that the PSC was effectively free :)

Tried Mandriva, Fedora and then finally went back to Debian because I didn't want to waste time trying to stumble around another distro. Yes, I've been too long on Debian (6 years) and every other distro seems to me as being deficient in some way or the other. Mandriva is too much GUI; it's almost as if it doesn't care about anything else. Fedora is really good, but just not Debian. It puts too much into the default install and seemed to want to connect to the internet each time I search for package descriptions on the package manager. Anyways, my opinion in this case is probably slanted because I tried Fedora only for a couple of hours, enough to download a Debian Netinstall CD image ;)

Exhausting week... with a hopeful end

2008-09-11T18:34:27Z

It's been (and continues to be) an exhausting week at work. I've been away from home from 6:00 AM to around 11:00 PM everyday and been buried upto my my brow in production problems, UAT releases and the "Why the hell is this written like this". Yahoo, MSN File Transfer have taken a reluctant back seat.

Between all this I got a response (two actually) to my request to my employers to sponsor my trip to Bangalore for FOSS.in if I get a chance to talk on Ayttm. I had made the request two weeks ago and finally got an encouraging response. Turns out that we have an "Open Source Group" and their Head seemed to be all for it.

Now waiting for FOSS.in/2008 to open up registrations so that we can propose a Project Day for Ayttm.