The Drill Hall is one of the buildings in Wellingborough earmarked for demolition.
The borough council says none of the buildings lost has any "inherent architectural value".
Part of the plan is to enlarge the existing conservation area to prot
ect places of local landscape merit.
Wellingborough councillors are being asked to approve the town centre area action plan at their development control meeting on Wednesday night.
The proposal is a mix between retail and office developments.
Albany House Medical Centre has expressed concerns about increased noise and pollution from the greater use of Queen Street.
Staff are also worried about the impact on parking and access for emergency vehicles because of the Northern Interceptor route.
The council says noise levels caused by Queen Street are not expected to be at a level preventing the opening of windows in the clinic.
Improved parking will be provided in a new multi-storey car park nearby, the report says.
Queen Street will have two lanes in one direction and there will be bus priority measures in Church Street.