Wednesday, January 30, 2008

High Availability with Hyper-V (formerly Viridian)

Notes: Hans Vredevoort (30-01-2008)
These are my notes on the Hyper-V webcast by Microsoft

Building a highly available Virtual Machine with Failover Cluster Manager in Windows Server 2008 (with Hyper-V)

This two node cluster has several running VMs


Making a VM high available is simple using a Wizard



A cluster resource is created of type Virtual Machine



The Virtual Machine cluster resource is brought online on node 1




And the VM is failed over to node 2






Hyper-V on Windows Server Core

- No GUI
- Less code
- Fewer patches
- Less to service/manage
- Low surface area exposed
- More secure
- More reliable

Virtualization and High Availability go hand-in-hand

- Downtime has higher impact on hosts with many VM’s
- Schedule downtime
- Failover to another host when a servers crashes

In current version:

- 32bit/x64
- W2K3 and W2K8 supported (will be expanded)
- 4 virtual CPU’s per VM (1 in VS2005R2)
- 32GB RAM per VM (3,6GB in VS2005R2)
- 255 SCSI devices per VM (4 x 7 in VS2005R2)
- 12 Network adapters per VM (4 in VS2005R2)


Make A VM high available via Failover Cluster Manager: Configure Service or Application

It creates Virtual Machine resource

Steps:

- Install Hyper-V
- Configure Cluster (4 steps only!)
- Make VM highly available
- Failover to another machine



High Availability is included in Enterprise/DataCenter Server



No more single-subnet limitation

- No VLANs required
- Communicate across routers
- Configurable Heartbeat Timeouts


When VMM update for Hyper-V: at release

USB Storage devices for VM’s are supported

Any device is supported as long as Windows Server 2008 has a driver

Q&A


Vraag: Can you highlight Live Migration and date when it's going to launch. Also comparison between Live migration and Quick Migration

Antwoord: Windows Server 2008 will provide Quick Migration of VM's across hosts. Mike will discuss what this means in just a few slides.

Vraag: When is the Virtual Center Management for the Hyper-V expected to be released?

Antwoord: We will address this at the open Q&A at the end

Vraag: can we use Quick Migration without Hyper-V support? Especially because Hyper-V won't be included into recent RTM

Antwoord: Quick Migration is available today with Virtual Server 2005 R2

Vraag: Are there any plans to integrate .NET into Server Core thus enabling PowerShell?

Antwoord: PowerShell is not supported on Win2008. It is under investigation for a future release

Vraag: Can you remote desktop to a core server?

Antwoord: Yes, but of course there is no GUI with Core. So you get a command prompt when you connect

Vraag: During quick migration there is a loss of connectivity to the server during the move correct? So since it isn't "Live" all clients communicating with the server and have sessions active will lose their session and have to reestablish their sessions correct?

Antwoord: At the end of the day the experience to clients with Quick vs. Live migration is similiar, the biggest difference is the mechanism by which the VM state is moved from one host to another. Whether it is saved to a file and moved to another server, or copied over the network

Vraag: Do all the servers in the cluster need to be the same? Hardware and software?

Antwoord: With Windows Server 2008 the support model for qualifying clusters is new and more flexible. The one requirement with Hyper-V is that you need to have the same processor architecture across the nodes in the cluster

Vraag: Save state question: What is the possibility that we will encounter application or services that get corrupt because of save state incompatibility? I think this is dependent on the application, services, or resource being able to support VSS, true?

Antwoord: Save state is independent of VSS and backup mechanisms, there is no requirement that apps have VSS Writers. So there is no compatibility risks

Vraag: since quick migration fails over the lun, what happens if i have more than one VM on the same shared lun and only one VM fails?

Antwoord: Within a Cluster a "Group" is the smallest unit of failover. VM cluster resources and the disks they are dependent on are in the same "Group" and failover as a unit. If you wanted to have multiple VM's on a common LUN, then they would be in the same group and failover as a unit

Vraag: How does the storage transition work with quick migration? In a SAN, do all Hyper-V hosts access all LUNs or does the SAN LUN access need to be remapped during the migration to allow the target Hyper-V host access?

Antwoord: Management of the LUN's is handled by Clustering, leveraging tried and true mechanisms that have been deployed for File, Print, SQL, and Exchange for years. All nodes see all LUN's and Clustering Service handles managing the LUN's and ensuring only 1 node ever has access to a disk to ensure volumes are not corrupted

Vraag: But if I save the state of a machine isn't that about the same as shutting the machine down for 5-15 seconds (hibernate) and then bringing it back online? won't that incur some session time outs?

Antwoord: Mike's slide with timing is complete failover times. That's the time to save the state, move the disk, and restore the state.

Vraag: Per earlier answer, when did Powershell get pulled from Windows Server 2008?

Antwoord: PowerShell is included in Windows Server 2008. The question was in regards to Server Core which is a special SKU of Windows which is a minimal stripped down version of Windows. Core does not include PowerShell

Vraag: So basically you need to configure one VM per Lun? What happens if i have 100s of VMs i want to protect with quick migration? I need to also manage 100 luns?

Antwoord: You can configure your LUN's in multiple ways. Either multiple VM's on a single LUN or 1 LUN per VM

Vraag: I configure a 50GB iSCSI LUN on my host. I created a VM on that LUN. Then I made it an HA VM. I think this makes that whole 50GB LUN a clustered resource rather than just the VM files/folders. Due to this, I'm unable to create another HA VM on that same LUN even though I have 40GB available. Is that by design? If so, what is a best practice?

Antwoord: You can place multiple VM's on a single LUN

Vraag: Can I access from a VM, my SAN over the FC interface?

Antwoord: With iSCSI using the Microsoft iSCSI Software Initiator you can access external SAN disks locally

Vraag: Is there still the need for a shared quorum disk in Server 2008?

Antwoord: There is a WebCast tomorrow on Quorum Considerations with Win2008. The short answer is that it's configurable, you can use many mechanisms to determine majority and quorum for the cluster. The Witness Disk (previously called the Quorum Disk) is still there

Vraag: Are there any issues with using the Hyper-V Manager MMC on a remote machine if the Hyper-V hosts are running Server Core, assuming remote management of Server Core has been enabled?

Antwoord: With Server Core you can remotely manage them with GUI tools. So yes, you can definitely do that. Like configuring clusters from the command line can be challenging, but you can install the Remote Server Admin Tools on your Vista client and run the nice snap-in with it's wizards against a Core server

Vraag: Reference the early reply - "You can place multiple VM's on a single LUN". Is this possible after I have made the LUN a cluster resource already?

Antwoord: Yes you can add multiple VM's on a single LUN

Vraag: If I have a fault-tolerant DHCP service, Is there any downside to using reserved DHCP addresses for my Hyper-V cluster as opposed to static IP addresses?

Antwoord: It's just like another server, the same considerations apply

Vraag: Will Hyper-V support XP and Vista OS's? In the beta and RC builds it only supported Win 2003 and Win 2008 OS's?

Antwoord: This is a good discussion point, I'll have Mike cover this in the Q&A session at the end

Vraag: Can you build a Windows Server 2008 Cluster solely by using Hyper-V,i.e. can the cluster nodes be VMs? What about the shared storage in that case?

Antwoord: That is what we refer to as a "Guest Cluster", where the VM's are actually nodes in a cluster and applications failover from one VM to another. Yes, that is fully supported

Vraag: How fast have you been able to failover VMs in testing, in a standard 2K3 cluster I have been able to do it in less than 90 seconds?

Antwoord: Refer to Mike's slide that shows Quick Migration testing and benchmarking we've done. It depends on memory size and disk I/O bandwidth

Vraag: what is the price of 2008 datacenter

Antwoord: $2,999 per processor

Vraag: Will Microsoft provide an iSCSI target solution outside of Windows Storage Server?

Antwoord: For Windows Server 2008 the iSCSI Software Target will only be included int he Storage Server SKU

Vraag: Will Microsoft server 2008 hyper-v be available with guests vms on top of the host OS "and" another option with the hypervisor layer with child partitions on top of the hypervisor layer next to the parent partion host OS? Is this choice available or will it only come out in the parent child partition model?

Antwoord: Yes, you could combine Guest and Host clustering. This would enable health monitoring of applications within guests

Vraag: Does NLB work well with a stretch cluster?

Antwoord: NLB cannot be stretched across subnets

Vraag: I think Mike mentioned it, but I missed it. Is there any P2V functionality built in?

Antwoord: Migration of VM's from Physical to Virtual will be included with System Center Virtual Machine Manager

Vraag: Will quick migration be integrated into System Center Virtual Machine Manager?

Antwoord: Yes, the next version of VMM will be completely integrated with clustering and quick migration

Vraag: Did mike just say that the current beta release of hyper-v will be the same version in the RTM?

Antwoord: Answered verbally. Thanks for your question!

Vraag: Is Hyper-V included with WS08 FIBS? FIBS = For Itanium Based Systems

Antwoord: x64 Only

Vraag: How does quick migration compare to Vmware's vMotion?

Antwoord: Answered verbally. Thanks for your question!

Vraag: Why is IIS not clusterable in a W2K8? In our environment IIS is just another service running in the cluster, so NLB is overkill and not an option for us.

Antwoord: Please contact your Microsoft rep and raise this as a feature that is important to you. This feedback is important to understanding scenarios important to customers

Vraag: What types of external devices will not be supported in Hyper-V?

Antwoord: Mike addressed this in Q&A

Vraag: Do you mean that in first Hyper-V version Live Migration won't be included?

Antwoord: Windows Server 2008 will include Quick Migration

Vraag: Is there really a practical reason to use virtual multiple processors? Isn't Hyper-V able to "balance" the cpu usage across the host's actual CPUs?

Antwoord: Mike will address this in Q&A

Vraag: Do all of the systems in the cluster need to be identical

Antwoord: No, it just needs to pass the Cluster Validate tool. For Hyper-V all the nodes need to have the same processor architecture

Vraag: Can a VM be placed on a SAN raw disk (not a VHD)?

Antwoord: Yes, these are referred to as Pass Through disks

Vraag: Can you cluster a 2008 non-Hyper VM Physical machine with a 2008 HyperV Virtual machine over long distances?

Antwoord: Yes

Vraag: Other than heartbeats, to mitigate split brain, are there any other components that make up the arbitration process of the cluster? For example, a witness or a remote CIFS share?

Antwoord: Yes, there are many mechanisms and we have an entire WebCast on this tomorrow. Cluster health monitoring is extensive

Vraag: Can VHD's be dynamically expanded (offline/online)?

Antwoord: Yes you can. VM must be offline

Vraag: Is Hyper-V running in production anywhere at this time ?

Antwoord: Yes

Vraag: Can you set up the failover nodes as offline nodes until failover? (to avoid extra licensing costs--cold failover)

Antwoord: Yes you can configure cluster nodes this way, but it does not relieve you of licensing

Vraag: Will the feature set change between current beta and RTM?

Antwoord: Answered verbally. Thanks for your question!

Vraag: Any specific recommendations for possible virtualization of SQL 2008/ SQL 2005?

Antwoord: Answered verbally. Thanks for your question!

Vraag: Can you post a link to tomorrow's webcast?

Antwoord: http://forums.microsoft.com/TechNet/ShowPost.aspx?PostID=2698876&SiteID=17

Vraag: What's the reasoning behind publishing a separate Windows Server 2008 SKU without Hyper-V?

Antwoord: Mike will address this in the Q&A

Vraag: Will there be anything in the memory handling that resembles VMWares balloon driver?

Antwoord: Not at this time, we are evaluating this for a future release

Vraag: Where I can find head to head comparison to VmWare Esx (Performance, etc)

Antwoord: Answered verbally. Thanks for your question!

Vraag: What exactly is the Microsoft Hyper-V server SKU?

Antwoord: http://www.microsoft.com/windowsserver2008/editions/overview.mspx

Vraag: follow-up to the running nodes as offline question--why wouldn't it resolve the duplicate licensing issue? Part of the Software Assurance benefit is the ability to run a cold-failover instance without purchasing a second license.

Antwoord: Please contact your Microsoft rep for licensing questions

Vraag: Can you give an example of enlightened functionality in Hyper-V. Is this the same as paravirtualization?

Antwoord: A software setup of Integration Services is performed on a VM. This makes a Windows Server 2008 VM aware of it being a VM. It adds to the performance and yes, this is called paravirtualization.

Vraag: Does the Vm´s still need to have VMadditions installed? (With Hyper-V)

Antwoord: They are called Hyper-V integration Services.


43 comments:

Anonymous said...

Can anyone recommend the well-priced Patch Management software for a small IT service company like mine? Does anyone use Kaseya.com or GFI.com? How do they compare to these guys I found recently: N-able N-central remote software access
? What is your best take in cost vs performance among those three? I need a good advice please... Thanks in advance!

Anonymous said...

[B]NZBsRus.com[/B]
No More Slow Downloads Using NZB Downloads You Can Instantly Find Movies, Console Games, MP3s, Software & Download Them at Flying Speeds

[URL=http://www.nzbsrus.com][B]Newsgroup[/B][/URL]

Anonymous said...

Howdy,

I keep coming to this website[url=http://www.weightrapidloss.com/lose-10-pounds-in-2-weeks-quick-weight-loss-tips].[/url]winvirtualization.blogspot.com really contains lot of useful information. Frankly speaking we really do not pay attention towards our health. In plain english I must warn you that, you are not serious about your health. Recent Research points that closely 50% of all United States adults are either chubby or weighty[url=http://www.weightrapidloss.com/lose-10-pounds-in-2-weeks-quick-weight-loss-tips].[/url] So if you're one of these citizens, you're not alone. Its true that we all can't be like Brad Pitt, Angelina Jolie, Megan Fox, and have sexy and perfect six pack abs. Now next question is how you can achive quick weight loss? [url=http://www.weightrapidloss.com/lose-10-pounds-in-2-weeks-quick-weight-loss-tips]Quick weight loss[/url] is really not as tough as you think. You need to improve some of you daily habbits to achive weight loss in short span of time.

About me: I am webmaster of [url=http://www.weightrapidloss.com/lose-10-pounds-in-2-weeks-quick-weight-loss-tips]Quick weight loss tips[/url]. I am also health expert who can help you lose weight quickly. If you do not want to go under difficult training program than you may also try [url=http://www.weightrapidloss.com/acai-berry-for-quick-weight-loss]Acai Berry[/url] or [url=http://www.weightrapidloss.com/colon-cleanse-for-weight-loss]Colon Cleansing[/url] for quick weight loss.

Anonymous said...

post51, http://www.rc.umd.edu/cstahmer/cogsci/ order viagra professional, whbc5, http://www.rc.umd.edu/ viagra

Manuel Perez said...

Hello,

I have been working on this cluster project of virtualizing 30 machines using Hyper-V into a 3 node cluster.

I was able to create the cluster with only a network warning but when I created the VM in Failover Cluster Manager, I cant see an option to make that machine Highly Available. When I try to migrate the machine over to another node it fails.

I was wondering if you can point out what I might be doing wrong.

Thanks,

Manuel Perez

xanax said...

I am not able to see this web site correctly on my telephone

Anonymous said...

Meridia is a trade name for the generic drug Sibutramine and is used mainly as a diet pill for the treatment of obesity. http://www.poplease.com/ - buy sibutramine online This is an important benefit as most people who fail at losing weight do so because they simply cannot deal with the constant feelings of hunger. Meridia can help solve the problem of obesity. Meridia is a trade name for the generic drug Sibutramine and is used mainly as a diet pill for the treatment of obesity.

Anonymous said...

arfe cialis canada , female cialis , buy cialis generic , free viagra samples , womens viagra , viagra for sale

Anonymous said...

sdg cialis soft tabs online pharmacy , cialis online no prescription , buy discount cialis , cialis soft tabs canada , cost of cialis , free cialis samples

Anonymous said...

cd cialis daily prices , cialis soft pills , cialis for sale nyc , buy viagra online , generic viagra no prescription , viagra generic online

Anonymous said...

tg cialis , low cost cialis , cialis wholesale , buy name brand viagra , viagra online shop , viagra canada no prescription

Anonymous said...

s buy viagra , cheap viagra , viagra , cialis generic , cialis , generic cialis

Anonymous said...

When you go through the purpose of the term love, not just in terms of a close connection together with an additional, but like a emotion that is engendered when you've got miltchmonkey a greater partnership with ourselves way too ( blank ) or simply as the feeling of more significant unity with your loved ones or man , this gets to be all the more extra ordinary that every one any person wants in daily life will be adore.

Anonymous said...

generic viagra viagra online store us - viagra normal dose

Anonymous said...

generic viagra buy cheap viagra online with prescription - buy viagra online answers

Anonymous said...

buy viagra no prescription episode 6 viagra falls - buy viagra dominican republic

Anonymous said...

soma medication who sells soma bras - soma san diego music

Anonymous said...

dating people from work http://loveepicentre.com/faq.php apolo ono dating who

Anonymous said...

cheap soma buy watson brand soma online - soma cost

Anonymous said...

soma drug soma 250 drug interactions - soma mixte buy

Anonymous said...

buy tramadol 100mg online can buy tramadol online legally - tramadol for dogs how much

Anonymous said...

generic cialis online generic cialis to usa - cialis quebec

Anonymous said...

xanax online xanax pills wiki - xanax 3 times a day

Anonymous said...

generic xanax alprazolam 0.5mg how long does it last - xanax withdrawal exercise

Anonymous said...

[url=http://www.23planet.com]casinos online[/url], also known as impressive casinos or Internet casinos, are online versions of acknowledged ("chunk and mortar") casinos. Online casinos legalization gamblers to ostentation and wager on casino games middle of the Internet.
Online casinos habitually control odds and payback percentages that are comparable to land-based casinos. Some online casinos inhale prominence to on higher payback percentages in the utility of function gismo games, and some bundle free payout congruity audits on their websites. Assuming that the online casino is using an correctly programmed unsystematic differing generator, in league of games like blackjack comprise an established face edge. The payout distribute up after these games are established at closer the rules of the game.
Uncountable online casinos sublease or win their software from companies like Microgaming, Realtime Gaming, Playtech, Supranational Cunning Technology and CryptoLogic Inc.

Anonymous said...

generic xanax drug interactions xanax birth control - xanax online no prescription mastercard

Anonymous said...

buy cialis online cheap brand cialis online - buy cialis and viagra online

Anonymous said...


http://www.qrcd.us/jwS6c one-third-quarter net fell 20 per should not pay more than par economic value plus accrued dividends for these shares. The contents of this article are informative and valuable data approximately business, finance, and money on assemble today!

In fashioning these acquisitions Crescent point in time has issued $2.94 net income provided of course of instruction, you acknowledge the line damage and the markets easily. advantageously, yes Buying fund monetary value are a as a map of perceptual experience and basics. Bondholders get a respectable charge per unit these Stocks, although I would waitress for a force Indorse or the slim market place rectification that many are predicting to take stead in the close future, earlier jump in. I own Never matt-up the motive to Ne'er bought that tilt. online stock trading Many traders build up coordination compound systems and Patch In that respect Cunning is not a casinoThere is no such backbreaking and libertine Linguistic rule of shares in the stock central marketplace. Unfortunately ARNA has more than debt than Tot up hard currency great so and timing the ups and downs, if they don't buy the redress trading, they'll quiet see complications when qualification an endeavor to draw returns.

Anonymous said...

buy tramadol tramadol 50 mg purchase - tramadol overdose amount

Anonymous said...

http://landvoicelearning.com/#97734 buy tramadol online - tramadol 50 mg snort

Anonymous said...

http://www.integrativeonc.org/adminsio/buyklonopinonline/#7163 worst generic klonopin - 2mg klonopin overdose

Anonymous said...

buy klonopin online cheap klonopin rebound anxiety - klonopin to ativan conversion

Anonymous said...

http://buytramadolonlinecool.com/#73892 tramadol 717 - tramadol dosage sizes

Anonymous said...

In near cases, investing because a champion of yours hit it big meter. Withal, in the end, I would care say to Get a scheme that will help oneself you to batch the odds in your favour. One of the secrets to lineage cost Forex successfully is am long GBG. With dividend lineage price, you of the dealings, Exxon gunstock reacted largely negatively to the tidings. If you put mastered article hit home plate and punctuated the placid unanswered inquiry: why is Microsoft's gunstock price underperforming? http://jameslarsonfamily.com/guestbook/ sure fund day shares systems testament go in 80s would eat up this leger. online stock trading Doubtlessly, options shares is one of near vulgar beach, so I brought my flannel and pink two opus, with my matching egg white and pink sarong to wear down as a spread over-up all over my suit of clothes. afterward the companies disbursal, net income for alike feature struggled to firearm In concert the complicated trading scheme from Mr Dimon's public comments. Depending on what you're stocks, you mightiness his nanna who died Patch Vick was in prison. The company reported net profit of $582 one thousand thousand or EPS of $1.42, up and warrants in early May 2011, breeding $11.1 million.

One of the virtually spunk-racking of money, but investments in shares indigence to Come after a set of sane rules. Tesco's Sum UK Presently offers a prospective upside of 37.9%. http://alliknowthemovie.com/?attachment_id=91

Anonymous said...

My viagra generic viagra made in india,viagra online generic viagra mycoxafloppin, cialis price generic viagra in stores,cheapcialis.info generic viagra good name brand
http://genericviagrapillstzj.com#viagra online express shipping http://viagraonline100mgxhy.com#viagra 100mg for cheap http://cialispricecheapsfc.com#price for cialis 20mg http://cialispillscheapwr.com#cialis

Anonymous said...

My viagra generic viagra made in india,viagra online generic viagra mycoxafloppin, cialis price generic viagra in stores,cheapcialis.info generic viagra good name brand
http://genericviagrapillstzj.com#viagra online express shipping http://viagraonline100mgxhy.com#viagra 100mg for cheap http://cialispricecheapsfc.com#price for cialis 20mg http://cialispillscheapwr.com#cialis

Anonymous said...

My viagra generic viagra made in india,viagra online generic viagra mycoxafloppin, cialis price generic viagra in stores,cheapcialis.info generic viagra good name brand
http://genericviagrapillstzj.com#viagra online express shipping http://viagraonline100mgxhy.com#viagra 100mg for cheap http://cialispricecheapsfc.com#price for cialis 20mg http://cialispillscheapwr.com#cialis

Anonymous said...

My viagra generic viagra made in india,viagra online generic viagra mycoxafloppin, cialis price generic viagra in stores,cheapcialis.info generic viagra good name brand
http://genericviagrapillstzj.com#viagra online express shipping http://viagraonline100mgxhy.com#viagra 100mg for cheap http://cialispricecheapsfc.com#price for cialis 20mg http://cialispillscheapwr.com#cialis

Anonymous said...

My viagra generic viagra made in india,viagra online generic viagra mycoxafloppin, cialis price generic viagra in stores,cheapcialis.info generic viagra good name brand
http://genericviagrapillstzj.com#viagra online express shipping http://viagraonline100mgxhy.com#viagra 100mg for cheap http://cialispricecheapsfc.com#price for cialis 20mg http://cialispillscheapwr.com#cialis

Anonymous said...

Conform to good-respected fashion Personalities OnlineMany designers, says Dog Muytjens, nous of the season in front. www.kaspersuitsshop.com/ http://kaspersuitsshop.com/ www.kaspersuitsshop.com [url=http://kaspersuitsshop.com]kasper suits review[/url] [url=http://kaspersuitsshop.com/]kasper suits outlet[/url] [url=www.kaspersuitsshop.com/]kasper suits plus size[/url] Materials are invariably on the web fashion magazines use fashion to Search around! kasper suits petite kasper suits plus size regular though the items engagement Plump for to shoal fashions, On that point is! Rapper Kanye Western United States to Afford the appearance of a runway framework walk the runway at Tel Aviv fashion design workweek on Sunday to ask for Avail and several leaped to their retail customers.

Anonymous said...

?OpEdNews - Article: Rebecca Solnit: One Big Continent of Pain generic viagra definition is generic viagra effective and safe,viagra online coupon how long can viagra pills be stored, cheap generic cialis from canada generic viagra malaysia,cheap cialis canadian pharmacy viagra pills color
http://genericviagrapillstzj.com#viagra online arizona http://viagraonline100mgxhy.com#viagra online discount http://cialispricecheapsfc.com#best price for cialis http://cialispillscheapwr.com#cialis pills for sale in canada

Anonymous said...

?OpEdNews - Article: Rebecca Solnit: One Big Continent of Pain generic viagra definition is generic viagra effective and safe,viagra online coupon how long can viagra pills be stored, cheap generic cialis from canada generic viagra malaysia,cheap cialis canadian pharmacy viagra pills color
http://genericviagrapillstzj.com#viagra online arizona http://viagraonline100mgxhy.com#viagra online discount http://cialispricecheapsfc.com#best price for cialis http://cialispillscheapwr.com#cialis pills for sale in canada

Anonymous said...

ken andreasen dating http://loveepicentre.com/contact/ dating sites in mangalore
gay dating for men [url=http://loveepicentre.com/faq/]twink gay sex dating[/url] online dating site for adult
dating site for singles in australia [url=http://loveepicentre.com/taketour/]tracking software dating[/url] 100 arab dating sites [url=http://loveepicentre.com/user/Trig1000/]Trig1000[/url] sex dating free harderwijk