It's chilly.

There is a little chill in the air.

There was a slight chill in the air.

Though the sun was shining, it was quite chilly today.

It's a bit cold, but it probably isn't worth putting the heater on yet.