Baskets that attach to the front of a bicycle are handy for putting loose items in and are useful for short rides on smooth surfaces. They are also harder to find and I had to take a trip to BicycleWA headquarters to locate some.
Instead of a handlebar bag, you could elect to use a front mounted basket for those short rides. You could also put your small pet dog into one of these.
