REAGAN IS PRODDED FOR DEFICIT ACTION
President Reagan was warned by home builders and bankers today that ''time is running out'' for dealing with the high Federal deficit and preventing a downturn of the business recovery. The President, while promising to work on the problem, said there was no direct tie between the large deficit and high interest rates. He said the larger problem was a baseless ''pessimism'' that the economic recovery might falter. 'A Pessimism Out There' Proof of this, he told a panel of builders and bankers who questioned him here, was the fact that while the prime interest rate fell in his Administration from 21.5 percent to 11 percent, ''our deficit was doubling.''