There's a big difference between getting a lot of saturated fats and getting a diet balanced in fats. The OP even said he doesn't eat enough for breakfast, an extra pint of milk for breakfast wont give him any problems if the rest of his diet is clean, plus the added calcium in the milk will help regulate the fat cells to burn more fat.
There was study I remember where full fat came out healthier than skimmed. http://news.bbc.co.uk/1/hi/health/6400171.stm Hmm, well it tastes better... Meridian do a peanut butter thats just, peanuts with no salt. Its gorgeous.
Weight gainers, whole milk, various types of nuts, etc. If you're serious, you can force feed yourself (a little extra each day) like I did. Over time, the amount of food your stomach can handle will increase. Also, eating lots of veggies w/ high fiber content throughout the day helped me increase my appetite and the volume of food I can eat (like a workout for your digestive organs).