The agp subsystem in the Linux kernel 2.6.38.5 and earlier does not properly restrict memory allocation by the (1) AGPIOC_RESERVE and (2) AGPIOC_ALLOCATE ioctls, which allows local users to cause a denial of service (memory consumption) by making many calls to these ioctls.
https://lkml.org/lkml/2011/4/14/294
https://bugzilla.redhat.com/show_bug.cgi?id=698999
http://www.securityfocus.com/bid/47832
http://www.kernel.org/pub/linux/kernel/v2.6/ChangeLog-2.6.38.5
http://securitytracker.com/id?1025441
http://openwall.com/lists/oss-security/2011/04/22/9
http://openwall.com/lists/oss-security/2011/04/22/8
http://openwall.com/lists/oss-security/2011/04/22/7
http://openwall.com/lists/oss-security/2011/04/22/11
http://openwall.com/lists/oss-security/2011/04/22/10