VMware Communities: Message List - how to list files in datastores?

Re: how to list files in datastores?

MorDrakka — Wed, 06 Aug 2008 09:54:02 GMT

Thanks for reply,

I used this thread because I thought code was the problem.

It is weird though, this morning I installed "VMware-Vim4PS-1.0.0-103777.exe, however Get-ViToolkitversion is not recognised as a cmdlet. I guess I reïnstall everything. Thanks.

Re: how to list files in datastores?

rusev — Wed, 06 Aug 2008 09:46:42 GMT

Hi all,

In VI Toolkit v1.0

First you need to

PS C:\> Get-Datastore

Name Provider Root ----

----

ds VimDatastore

Now you can 'cd'

PS C:\> cd ds:
PS ds:\> dir

Datastore path:
LastWriteTime

----

----
2/25/2008 6:11 PM 2/24/2008 8:19 AM 2/24/2008 12:07 AM 6/16/2008 2:27 PM 2/24/2008 11:10 PM 6/20/2008 11:57 AM 8/6/2008 11:15 AM 8/5/2008 5:07 PM 8/6/2008 11:25 AM 6/6/2008 2:22 PM 6/24/2008 2:29 PM 8/6/2008 11:00 AM

Re: how to list
LucD — Wed, 06 Aug 2008 09:40:26 GMT there is a datastore provider. This may be very interesting feature to use in some cases. Here is how you can use it:
mount the datastore provider to some drive:
-Name "storage1 (3)"| New-DatastoreDrive -Name "ds"
CurrentLocation
\Datastore\443@10.23.113.41\Data...
to it and do all directory operations you like:
storage1 (3)
Type Length Name
Folder Win2003 64bit Template
Folder Win2003 32bit Template
Folder WinXP 32bit Template
Folder RedHat 9 Template
Folder WinXP 64bit Template
Folder PS20_win2003
Folder testMachine_Vista_32bit
Folder testMachine_2003_64bit
Folder testMachine_XP_64bit
Folder Ubuntu
Folder WinVista Business 64b...
Folder VC4.0
files in datastores?

I suspect you are using VI Toolkit v1 (use Get-VIToolkitversion to check, it should return build 103777).
If yes, the Get-View cmdlet has changed.

Do a Get-Help Get-View to see the new syntax.

PS: try to open a new thread for a new question, it makes it easier for other community members to follow

Re: how to list files in datastores?

MorDrakka — Wed, 06 Aug 2008 09:25:56 GMT

I am trying to create a script that will list all vmdk's on all datastores. This script given here is my starting point. However I cannot make this work.

$ds = Get-Datastore | %{Get-View $_.Id}

Script errors on this. Each time I run this script I get an error like

A parameter cannot be found that matches parameter name 'Datastore-datastore-20029'

At line 18, position 110
$ds = Get-Datastore | %{Get-View $_.Id}

So I am thinking the problem is $_.id is "Datastore-datastore-20029" and Get-view does not recognize this. When I removed $_.I, i received a popup to enter a MoRef.

Anyonhe cahelp me with this? I just need a script that lists all files on a datastore.

Re: how to list files in datastores?

benham — Fri, 27 Jun 2008 02:51:16 GMT

For some reason, some datastore takes a very very long time to generate. Any particular reason?

Re: how to list files in datastores?

ykalchev — Thu, 26 Jun 2008 11:41:33 GMT

You can just add the code for one datastore in a loop for each datastore you get:

Get-Datastore <filter> | % {
$ds = Get-View $_.Id

process datastore files here

}

So the script will look smth like this:

Get-Datastore <search criteria> | % {
$ds = Get-View $_.Id

$fileQueryFlags = New-Object VMware.Vim.FileQueryFlags
$fileQueryFlags.FileSize = $true
$fileQueryFlags.FileType = $true
$fileQueryFlags.Modification = $true
$searchSpec = New-Object VMware.Vim.HostDatastoreBrowserSearchSpec
$searchSpec.details = $fileQueryFlags
$searchSpec.sortFoldersFirst = $true
$rootPath = "{0}" -f ($ds.summary.Name)

$dsBrowser = Get-View $ds.browser
$searchResult = $dsBrowser.SearchDatastoreSubFolders($rootPath, $searchSpec)
$fileList = @{}
foreach ($folder in $searchResult) {
foreach ($fileResult in $folder.File) {
$file = "" | select Name, Size, Modified, FullPath
$file.Name = $fileResult.Path
$file.Size = $fileResult.Filesize
$file.Modified = $fileResult.Modification
$file.FullPath = $folder.FolderPath + $file.Name
$fileList.Add($file.FullPath, $file)
}
}
}

$fileList.Values | select Name, Size, Modified, FullPath | export-csv "datastore.csv"

Regards,
Yasen

Re: how to list files in datastores?

benham — Thu, 26 Jun 2008 09:56:53 GMT

How can I loop it, so that I can capture multiple selected datastore? e.g. of certain naming convention type?

Pardon me, I am very new to PowerShell, still trying to learn the basics.

Cheers!

Re: how to list files in datastores?

benham — Thu, 26 Jun 2008 08:33:39 GMT

Perfect, that's what I need. Appreciate it very much. Cheers!

Re: how to list files in datastores?

c_shanklin — Wed, 25 Jun 2008 13:49:34 GMT

benham wrote:
Hi,

Would like to find out how to list all the files and size in datastore? The objective is to help generate a spreadsheet for storage planning.

Anyone has a sample script?

Could not seem to get it working with get-datastore.
Another alternative if you're feeling a bit adventurous would be to use the community extensions. There is a cmdlet within the extension called get-datastorefiles.

Basically the full script you would use is:

(new-object net.webclient).DownloadString("http://communities.vmware.com/servlet/JiveServlet/downloadBody/6051-102-1-3481/Extensions.psm1") > $env:temp/Extensions.psm1
add-module $env:temp/Extensions.psm1
get-datastorefiles (get-datastore ds1,ds2,ds3)

This will return an array of objects that you can use on the pipeline, etc. Note: This requires the latest PowerShell 2 CTP.

Re: how to list files in datastores?

ykalchev — Wed, 25 Jun 2008 10:58:07 GMT

I've just collect all files into a hashtable and then pipe then to export-cvs

$fileList = @{}
foreach ($folder in $searchResult) {
foreach ($fileResult in $folder.File) {
$file = "" | select Name, Size, Modified, FullPath
$file.Name = $fileResult.Path
$file.Size = $fileResult.Filesize
$file.Modified = $fileResult.Modification
$file.FullPath = $folder.FolderPath + $file.Name
fileList.Add($file.FullPath, $file)
}
}

$fileList.Values | select Name, Size, Modified, FullPath | export-csv "datastore.csv"

Regards,
Yasen

Re: how to list files in datastores?

benham — Wed, 25 Jun 2008 09:25:42 GMT

Yasen,

Perfect, it works fine except the output is on to screen with repeated header lines.

How can it be modified to write to a CSV file? I tried the export-CSV, it seems that there is only 1 line of output.

Re: how to list files in datastores?

ykalchev — Wed, 25 Jun 2008 07:36:43 GMT

Hi
You can use SearchDatastoreSubFolders of the HostDatastoreBrowser object to browse all files in the datastore

$ds = Get-Datastore <datastorename> | %{Get-View $_.Id}

$fileQueryFlags = New-Object VMware.Vim.FileQueryFlags
$fileQueryFlags.FileSize = $true
$fileQueryFlags.FileType = $true
$fileQueryFlags.Modification = $true

$searchSpec = New-Object VMware.Vim.HostDatastoreBrowserSearchSpec
$searchSpec.details = $fileQueryFlags
$searchSpec.sortFoldersFirst = $true

$dsBrowser = Get-View $ds.browser

$rootPath = "{0}" -f ($ds.summary.Name)
$searchResult = $dsBrowser.SearchDatastoreSubFolders($rootPath, $searchSpec)
foreach ($folder in $searchResult) {
foreach ($fileResult in $folder.File) {
$file = "" | select Name, Size, Modified, FullPath
$file.Name = $fileResult.Path
$file.Size = $fileResult.Filesize
$file.Modified = $fileResult.Modification
$file.FullPath = $folder.FolderPath + $file.Name
$file | out-default
}
}

You can also check query property of the SearchSpec object in order to filter files by type(i.e. only VmDisk or Vmconfig files)Regards,

Yasen

Re: how to list files in datastores?

ykalchev — Wed, 25 Jun 2008 08:18:10 GMT

It seems the code didn't show correct on IE. I've update the script code and I hope it's looking good now.

Yes It's VI Toolkit for Windows script

Re: how to list files in datastores?

benham — Wed, 25 Jun 2008 08:00:55 GMT

Yasen,

Is that perl or Powershell script? I would like to do with the Powershell VI Toolkit if possible.

how to list files in datastores?

benham — Wed, 25 Jun 2008 04:08:42 GMT

Hi,

Would like to find out how to list all the files and size in datastore? The objective is to help generate a spreadsheet for storage planning.

Anyone has a sample script?

Could not seem to get it working with get-datastore.