The backbencher was challenged during an interview on LBC over the growth in food banks under the Conservative Government.
He said it had happened because of a change in rules allowing JobCentre staff to inform clients of their availability, adding: “To have charitable support given by people voluntarily to support their fellow citizens I think is rather uplifting and shows what a good, compassionate country we are.
“Inevitably, the state can’t do everything, so I think that there is good within food banks.
“The real reason for the rise in numbers is that people know that they are there and Labour deliberately didn’t tell them.”
Ian Lavery, Labour MP and the party’s national campaign coordinator, labelled Mr Rees-Mogg an “out-of-touch Tory” following the comments.
He said: “The real reason people are going to food banks in record numbers is because the Tories have slashed public sector jobs and living standards over the last seven years, plunging more families into poverty and homelessness.
“This kind of comment shows Jacob Rees-Mogg really is the dictionary definition of an out-of-touch Tory.”
The Trussell Trust, which co-ordinates a network of food banks across the country, also responded to the comments.
Garry Lemon, the head of media and external affairs, said: “People are in real need, and it is clear that the dramatic rise in food bank use over the past five years cannot be attributed to awareness alone.
“We agree that the work of volunteers and voluntary organisations is uplifting, but food banks are an emergency service and whilst they do all they can to offer support to people in crisis they cannot solve structural problems alone.
“More can and must be done at all levels of UK government to recognise and find solutions to the issues which drive food bank use and we are keen to work with politicians, businesses and other charities to tackle hunger in communities across the UK.”