Timeout on while doing yum repodata

I am setting up a repo.

[root@vm1-msdp yum.repos.d]# cat /etc/yum.repos.d/test.repo
[TestRepo]
name=Test
baseurl=http://yum2.linux.test.se/repos/rhel-7-server-rpms/
enabled=1

When I do a yum repolist, I get:

Loaded plugins: product-id, subscription-manager
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Setting up Update Process
http://yum2.linux.test.se/repos/rhel-7-server-rpms/repodata/repomd.xml: [Errno 12] Timeout on http://yum2.linux.test.se/repos/rhel-7-server-rpms/repodata/repomd.xml: (28, 'Operation too slow. Less than 1 bytes/sec transfered the last 30 seconds')

Doing a curl gives me:

[root@vm1-msdp yum.repos.d]# curl http://yum2.linux.test.se/repos/rhel-7-server-rpms/repodata/repomd.xml
<?xml version="1.0" encoding="UTF-8"?>
<repomd xmlns="http://linux.duke.edu/metadata/repo" xmlns:rpm="http://linux.duke.edu/metadata/rpm"><revision>1477136247</revision>
<data type="filelists"><location href="repodata/e8b2ba9dc47e59779fd62e4e620d384980eb7346-filelists.xml.gz" /><timestamp>1477137036</timestamp><size>13356678</size><checksum type="sha1">e8b2ba9dc47e59779fd62e4e620d384980eb7346</checksum><open-size>211256992</open-size><open-checksum type="sha1">692da7344d647c557e13c391bf111e8758c6c6a1</open-checksum></data>
<data type="other"><location href="repodata/3e1db65591b231a193d77afcddc10cd4dc893086-other.xml.gz" /><timestamp>1477137042</timestamp><size>2711908</size><checksum type="sha1">3e1db65591b231a193d77afcddc10cd4dc893086</checksum><open-size>30164660</open-size><open-checksum type="sha1">d5e29adb5726418c9df5607bd4b63f66e9c60644</open-checksum></data>
<data type="primary"><location href="repodata/944a22df6cce5fc0c55475d8203f85a61ff4d32f-primary.xml.gz" /><timestamp>1477137044</timestamp><size>13251254</size><checksum type="sha1">944a22df6cce5fc0c55475d8203f85a61ff4d32f</checksum><open-size>112601964</open-size><open-checksum type="sha1">cab4ad29354193aabb379a32784dfc5431add5c1</open-checksum></data>
<data type="updateinfo"><location href="repodata/620075edbe03bbe5870d429c4e039afbaf7cb562-updateinfo.xml.gz" /><timestamp>1477137104</timestamp><size>1639354</size><checksum type="sha1">620075edbe03bbe5870d429c4e039afbaf7cb562</checksum><open-size>13020728</open-size><open-checksum type="sha1">faee80f3507caebb38379bedd8e8f196ca84521e</open-checksum></data>
<data type="group"><location href="repodata/aa67b97e3fbef6421b210478363475511304ef49-comps.xml" /><timestamp>1477137106</timestamp><size>604619</size><checksum type="sha1">aa67b97e3fbef6421b210478363475511304ef49</checksum></data>
<data type="productid"><location href="repodata/productid" /><timestamp>1477133513</timestamp><size>2159</size><checksum type="sha1">b4fc314796c31e66522014ac1e50f68da1e23f7a</checksum></data>
</repomd>

All other tests seem to be positive.

[root@vm1-msdp yum.repos.d]# ping yum2.linux.test.se
PING satellite6.lab.linux.test.se (10.51.58.113) 56(84) bytes of data.
64 bytes from 10.51.58.113: icmp_seq=1 ttl=46 time=113 ms
64 bytes from 10.51.58.113: icmp_seq=2 ttl=46 time=113 ms

So im confused as to why am I still seeing a Timeout.

You can reach the server via icmp, have you verified you can reach it on the ports that yum is using?

telnet satellite6.lab.linux.test.se 80
telnet satellite6.lab.linux.test.se 443