The Battery is home to Chain Rock, a rocky outcrop where a large chain and anti-submarine nets were anchored connecting to Fort Amherst to prevent German U-boats from entering the harbour during World War II.
Chain Rock is on one side of the harbour, and its sister, Pancake Rock, is located on the south side of the harbour near Fort Amherst.