When you are planning to Visit Milpitas and specially for Temple. you can do Panchtithi, but keep in Mind the timings as every temple has their own timings.
I have visited most of them except for Nithyanada temple but have heard they have huge idols like livermore temple. It is behind O Mei Kung fu Academy.
1) Jain Temple on Main Street
2) when you go one mile ahead on main street visit Haveli
25 Corning Avenue
Milpitas, CA 95035-5336
(408) 586-0006
3) 2 temples in one same complex Nithyananda temple
http://www.vedictemplebayarea.org/
and Veda Temple (shiv /ganesh)
http://siliconvalleytemple.net/contactus.html
4) Swaminaryan Temple
http://www.swaminarayan.org/globalnetwork/america/sanjose.htm
5) Sai Baba Temple .. very nice, peaceful and the meditation room is Awesome.
6) gurudwara
all within 3 to 5 miles …
Good one Poonamben. good idea for Panchtithi