There has been a lot of interesting discussion on the benefits and negatives of a stable API on this thread, with good points being made on both sides. If you don’t know or care what that is about, then just move along, nothing to see here…But if you are interested, Greg Kroah-Hartman (an advocate of the changing API) sent me a document that may be worth reading. It is, in essence, the argument opposing the stable API:The Linux Kernel Driver Interface (all of your questions answered and then some)Greg Kroah-Hartman
- Depending on the version of the C compiler you use, different kernel data structures will contain different alignment of structures, and possibly include different functions in different ways (putting functions inline or not.) The individual function organization isn’t that important, but the different data structure padding is very important.
- Depending on what kernel build options you select, a wide range of different things can be assumed by the kernel:
- different structures can contain different fields
- Some functions may not be implemented at all, (i.e. some locks compile away to nothing for non-SMP builds.)
- Memory within the kernel can be aligned in different ways, depending on the build options.
- Linux runs on a wide range of different processor architectures. There is no way that binary drivers from one architecture will run on another architecture properly.
Now a number of these issues can be addressed by simply compiling your module for the exact specific kernel configuration, using the same exact C compiler that the kernel was built with. This is sufficient if you want to provide a module for a specific release version of a specific Linux distribution. But multiply that single build by the number of different Linux distributions and the number of different supported releases of the Linux distribution and you quickly have a nightmare of different build options on different releases. Also realize that each Linux distribution release contains a number of different kernels, all tuned to different hardware types (different processor types and different options), so for even a single release you will need to create multiple versions of your module.Trust me, you will go insane over time if you try to support this kind of release, I learned this the hard way a long time ago…Stable Kernel Source InterfacesThis is a much more “volatile” topic if you talk to people who try to keep a Linux kernel driver that is not in the main kernel tree up to date over time.Linux kernel development is continuous and at a rapid pace, never stopping to slow down. As such, the kernel developers find bugs in current interfaces, or figure out a better way to do things. If they do that, they then fix the current interfaces to work better. When they do so, function names may change, structures may grow or shrink, and function parameters may be reworked. If this happens, all of the instances of where this interface is used within the kernel are fixed up at the same time, ensuring that everything continues to work properly.As a specific examples of this, the in-kernel USB interfaces have undergone at least three different reworks over the lifetime of this subsystem. These reworks were done to address a number of different issues:
- A change from a synchronous model of data streams to an asynchronous one. This reduced the complexity of a number of drivers and increased the throughput of all USB drivers such that we are now running almost all USB devices at their maximum speed possible.
- A change was made in the way data packets were allocated from the USB core by USB drivers so that all drivers now needed to provide more information to the USB core to fix a number of documented deadlocks.
This is in stark contrast to a number of closed source operating systems which have had to maintain their older USB interfaces over time. This provides the ability for new developers to accidentally use the old interfaces and do things in improper ways, causing the stability of the operating system to suffer.In both of these instances, all developers agreed that these were important changes that needed to be made, and they were made, with relatively little pain. If Linux had to ensure that it preserve a stable source interface, a new interface would have been created, and the older, broken one would have had to be maintained over time, leading to extra work for the USB developers. Since all Linux USB developers do their work on their own time, asking programmers to do extra work for no gain, for free, is not a possibility.Security issues are also very important for Linux. When a security issue is found, it is fixed in a very short amount of time. A number of times this has caused internal kernel interfaces to be reworked to prevent the security problem from occurring. When this happens, all drivers that use the interfaces were also fixed at the same time, ensuring that the security problem was fixed and could not come back at some future time accidentally. If the internal interfaces were not allowed to change, fixing this kind of security problem and insuring that it could not happen again would not be possible.Kernel interfaces are cleaned up over time. If there is no one using a current interface, it is deleted. This ensures that the kernel remains as small as possible, and that all potential interfaces are tested as well as they can be (unused interfaces are pretty much impossible to test for validity.)What to doSo, if you have a Linux kernel driver that is not in the main kernel tree, what are you, a developer, supposed to do? Releasing a binary driver for every different kernel version for every distribution is a nightmare, and trying to keep up with an ever changing kernel interface is also a rough job.Simple, get your kernel driver into the main kernel tree (remember we are talking about GPL released drivers here, if your code doesn’t fall under this category, good luck, you are on your own here, you leech
- The quality of the driver will rise as the maintenance costs (to the original developer) will decrease.
- Other developers will add features to your driver.
- Other people will find and fix bugs in your driver.
- Other people will find tuning opportunities in your driver.
- Other people will update the driver for you when external interface changes require it.
- The driver automatically gets shipped in all Linux distributions without having to ask the distros to add it.
As Linux supports a larger number of different devices “out of the box” than any other operating system, and it supports these devices on more different processor architectures than any other operating system, this proven type of development model must be doing something right 🙂
Thanks to Randy Dunlap, Andrew Morton, David Brownell, Hanna Linder, Robert Love, and Nishanth Aravamudan for their review and comments on early drafts of this paper.[SOURCE]
Kewl! Now if someone could only explain why Firefox needs a whopping 34 megs of memory just to get to the home page and then sucks up an additional 11 when I go to scienceblogs, I’d be thrilled. Is this the price I pay for running it on a Windoze machine?!!
It’s not because it’s Windows, Ian; Firefox behaves the same way on all of my Linux machines too. I haven’t booted Windows in months, so I can’t quickly check whether IE is the same or worse, but I seem to remember that the only reason it seemed better was that much of its memory usage was hidden in other not-obviously-IE parts of the system.BTW, Greg, I replied to this on my own blog, at http://pl.atyp.us/wordpress/?p=1270. I tried to trackback but assume you have those disabled.
I think I can smell the monolithic vs. microkernel wars warming up…
My trackbacks are not disabled. They simply don’t exist, their choice, apparently. It may be something going on scienceblog-wide. Trackbacks are the new spam, so there may be some level at which they don’t get to me.