Even though they started going out, Chikage had to endure the loneliness of not being able to see Ji