Wednesday, May 24, 2017

Add Custom Configuration Elements in .net

When we talk about configuration file in .net the obvious first question that pops up in our mind is what is a configuration file? and why do we actually need it?
According to MSDN, the Configuration files are the XML files that can be changed as needed.The reason why we actually need them is that we can change some data that may be required by the application without recompiling the application again.
While working with the .net application we come across two very common configuration files ie. app.config and web.config.Both these configuration files have a tag, where we can add the settings related to an application.But appSetting tag allows us to add only key value pair.
<appsettings> <add key="" value=""> </appsettings>

But there are many scenarios where we want our settings to be something more than just key value pairs.
To overcome this situation Microsoft provides many classes that allow us to write our custom configuration section.All the classes related to these are present in System.Configuration dll.In this sample application, I will show how to create your custom configuration section Group, configuration section, configuration element.In the later part of this sample, I will be showing how to add intellisence to our custom tags in visual studio.
First of all, we will create a new class library project and name it as Custom tags.



Now we will add the reference to System.Configuration to the project.
First of all, we will create a class that represents the innermost element of the custom section in our case it is company tag.For creating a configuration element we need to inherit it from ConfigurationElement class.Now we need to define the attributes of the configuration element.For this, we will create public properties and add a ConfigurationPropertyAttribute to it.This ConfigurationProperty attribute has various parameters like name, DefaultValue, IsKey, IsRequired.Below is the screen shot of the CompanyElement class.

#region Company Element public class CompanyElement : ConfigurationElement { [ConfigurationProperty("name", DefaultValue = "", IsKey = true, IsRequired = true)] public string Name { get { return (string)this["name"]; } set { this["name"] = value; } } [ConfigurationProperty("shortName", DefaultValue = "", IsRequired = true)] public string ShortName { get { return (string)this["shortName"]; } set { this["shortName"] = value; } } [ConfigurationProperty("companyCode", DefaultValue = "", IsRequired = true)] public string CompanyCode { get { return (string)this["companyCode"]; } set { this["companyCode"] = value; } } } #endregion

Now our Company Element is ready, we need to create a collection of type Company Element.To achieve this we need to create a class CompanyElementCollection which inherits from ConfigurationElementCollection which is an abstract class, so we need to provide the implementation of its two abstract methods and will add ConfigurationCollection attribute to it.This ConfigurationCollection attribute has four parameters.First is the type of items that this collection will contain and the remaining three parameters are AddItemName, ClearItemsName, and RemoveItemName.If we don’t supply the AddItemName we will get add tag instead of company tag.
#region CompanyElement Collection [ConfigurationCollection(typeof(CompanyElement), AddItemName = "company")] public class CompanyElementCollection : ConfigurationElementCollection { protected override ConfigurationElement CreateNewElement() { return new CompanyElement(); } protected override object GetElementKey(ConfigurationElement element) { return ((CompanyElement)element).Name; } } #endregion

Now we are done with creating an element and its collection, we will create a new class CompanySection that inherits from ConfigurationSection.Our CompanySection will contain a public property of type company collection and decorated by attribute ConfigurationProperty. We will add the name for the property collection and set IsDefaultCollection to true as it is our default collection.
#region Company Section public class CompanySection : ConfigurationSection { [ConfigurationProperty("companies", IsDefaultCollection = true)] public CompanyElementCollection Companies { get { return (CompanyElementCollection)this["companies"]; } set { this["companies"] = value; } } } #endregion

We can have multiple sections in our application that can be grouped into one.To highlight this I have created one more section
#region Settings Section public class SettingSection : ConfigurationSection { [ConfigurationProperty("countrycode", DefaultValue = "", IsKey = true, IsRequired = true)] public string CountryCode { get { return (string)this["countrycode"]; } set { this["countrycode"] = value; } } [ConfigurationProperty("isenabled", DefaultValue = true, IsRequired = true)] public bool IsEnabled { get { return (bool)this["isenabled"]; } set { this["isenabled"] = value; } } } #endregion

Now we will create a new class MySectionGroup that inherits from ConfigurationSectionGroup. In this class, we will add two public properties that will return the sections that we have created.
#region MySection Group public class MySectionGroup : ConfigurationSectionGroup { [ConfigurationProperty("setting", IsRequired = false)] public SettingSection GeneralSettings { get { return (SettingSection)base.Sections["setting"]; } } [ConfigurationProperty("companySection", IsRequired = false)] public CompanySection ContextSettings { get { return (CompanySection)base.Sections["companySection"]; } } } #endregion

Now we will build our class library project and create its dll.Once our project builds successfully, we can test it by creating a console application and add reference of our dll to it. Open the App.config file and add the configSections,sectionGroup, and section to it.We need to specify the name and fully qualified type of all the section and section group.
<configSections> <sectionGroup name="mysection" type="CustomTags.MySectionGroup,CustomTags"> <section name="companySection" type="CustomTags.CompanySection,CustomTags"/> <section name="settingSection" type="CustomTags.SettingSection,CustomTags"/> </sectionGroup> </configSections>

Note: configSections must be the first tag inside the configuration element otherwise you may end up in getting “The parameter 'sectionGroupName' is invalid” when you try to access a section from code.
Now we will add our custom tags in App.config file.

<mysection xmlns="http://tempuri.org/XMLSchema.xsd"> <settingSection countrycode="US" isenabled='true' /> <companySection> <companies> <company name="Microsoft Corporation" shortName="MSFT" companyCode="MSFT"/> <company name="Yahoo" shortName="YHOO" companyCode="YHOO"/> </companies> </companySection> </mysection>

We will now try to access these tags from code.Below is the code snippet for the same. br/>
class Program { static void Main(string[] args) { MySectionGroup group= ConfigurationManager.OpenExeConfiguration(ConfigurationUserLevel.None).SectionGroups["mysection"] as MySectionGroup; foreach (ConfigurationSection section in group.Sections) { Console.WriteLine("\n\n==========================================="); Console.WriteLine(section.SectionInformation.Name.ToUpper()); Console.WriteLine("==========================================="); if (section.GetType() == typeof(CompanySection)) { CompanySection c = (CompanySection)section; CompanyElementCollection coll = c.Companies; foreach (CompanyElement item in coll) { Console.WriteLine("|{0,25}| {1,6}| {2,6}|", item.Name, item.ShortName , item.CompanyCode); Console.WriteLine("-------------------------------------------"); } } else if (section.GetType() == typeof(SettingSection)) { SettingSection s = (SettingSection)section; Console.WriteLine("|{0,2}| {1,5}| ", s.CountryCode, s.IsEnabled); Console.WriteLine("-------------------------------------------"); } } Console.ReadLine(); } }


We have successfully created a custom section and we are able to access its values from code.But still, we have one issue ie visual studio doesn’t provide intellisense for the tags.This is because the visual studio does not contain the schema definition for our tags. To do this we have a simple hack.Open App.config, go to the XML menu item in the menu bar and click create the schema.This will create an xsd file.Copy your element from this file.
<xs:element name="mysection"> <xs:complexType> <xs:sequence> <xs:element name="settingSection"> <xs:complexType> <xs:attribute name="countrycode" type="xs:string" use="required" /> <xs:attribute name="isenabled" type="xs:boolean" use="required" /> </xs:complexType> </xs:element> <xs:element name="companySection"> <xs:complexType> <xs:sequence> <xs:element name="companies"> <xs:complexType> <xs:sequence> <xs:element maxOccurs="unbounded" name="company"> <xs:complexType> <xs:attribute name="name" type="xs:string" use="required" /> <xs:attribute name="shortName" type="xs:string" use="required" /> <xs:attribute name="companyCode" type="xs:string" use="required" /> </xs:complexType> </xs:element> </xs:sequence> </xs:complexType> </xs:element> </xs:sequence> </xs:complexType> </xs:element>

Now add a new schema file to your project and add the above code in it and save it.Now again go to App.config properties and browse your schema file and add it.



This will enable intellisense for your custom tags.

Tuesday, March 21, 2017

The Microsoft Jet database engine could not find the object 'Sheet1$_' issue while reading multiple sheets in excel.

In most of the applications where we gave the user the option to upload data using excel .User can upload an excel sheet containing multiple sheets.
But some times when the user uploads excel he may get the below error
"The Microsoft Jet database engine could not find the object 'Sheet1$_'.
Make sure the object exists and that you spell its name and the path name correctly."
Now when we go through the excel sheet uploaded by the user we couldn't find the Sheet with _.
So where does this sheet come from.The answer to this question is that when we apply filter to a sheet then Microsoft creates a hidden sheet to show filtered data.
So does this mean that we can remove the above error by just removing the filter.The answer is no .Even though we remove the filter from the sheet ,still the hidden sheet is there and while uploading excel this will throw error.
So how to solve this problem.Now we can solve this problem in 2 ways
1)Create a new excel sheet and copy all the sheets to that sheet and upload.
2)Handle the hidden sheet in code.
First option is fine when we have limited users and limited sheets .But we cannot ask a user to do create a new sheet with filter .So in this article i will show how to handle this issue in Asp.net MVC.

First of all we will create a ImportExcel in Home Controller which returns a View.This method will return a View for Get Request. Now we will create another method ImportExcel1 and decorate it with [HttpPost] Attribute.Since in MVC 2 Methods cannot have same method name,we can call 2 actions using Action Name attribute .So we will decorate ImportExcel1 with [ActionName("Importexcel")]. Now if we make a get request then ImportExcel will be called and for post request ImportExcel1 will be called.Below is the code to read excel files.
using System; using System.Collections.Generic; using System.Data; using System.Data.OleDb; using System.IO; using System.Linq; using System.Web; using System.Web.Mvc; using ExcelUpload.Models; namespace ExcelUpload.Controllers { public class HomeController : Controller { public ActionResult ImportExcel() { return View(); } [ActionName("Importexcel")] [HttpPost] public ActionResult Importexcel1() { if (Request.Files["FileUpload1"].ContentLength > 0) { string extension = System.IO.Path.GetExtension(Request.Files["FileUpload1"].FileName).ToLower(); string query = null; string connString = ""; string[] validFileTypes = { ".xls", ".xlsx" }; string path1 = string.Format("{0}/{1}", Server.MapPath("~/Content/Uploads"), Request.Files["FileUpload1"].FileName); if (!Directory.Exists(path1)) { Directory.CreateDirectory(Server.MapPath("~/Content/Uploads")); } if (validFileTypes.Contains(extension)) { if (System.IO.File.Exists(path1)) { System.IO.File.Delete(path1); } Request.Files["FileUpload1"].SaveAs(path1); //Connection String to Excel Workbook if (extension.Trim() == ".xls") { connString = "Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" + path1 + ";Extended Properties=\"Excel 8.0;HDR=Yes;IMEX=2\""; DataSet dt = Utility.ConvertXSLXtoDataSet(path1,connString); ViewBag.Data = dt; } else if (extension.Trim() == ".xlsx") { connString = "Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + path1 + ";Extended Properties=\"Excel 12.0;HDR=Yes;IMEX=2\""; DataSet dt = Utility.ConvertXSLXtoDataSet(path1, connString); ViewBag.Data = dt; } } else { ViewBag.Error = "Please Upload Files in .xls, .xlsx or .csv format"; } } return View(); } } }
Here we have created a static class Utility ,which contains a method ConvertXSLXtoDataSet. Below is the code for Utility class.
using System; using System.Collections.Generic; using System.ComponentModel; using System.Data; using System.Data.SqlClient; using System.IO; using System.Linq; using System.Web; using System.Data.OleDb; namespace ExcelUpload.Models { public static class Utility { public static DataSet ConvertXSLXtoDataSet(string strFilePath, string connString) { OleDbConnection oledbConn = new OleDbConnection(connString); DataTable dt = new DataTable(); DataSet ds = new DataSet(); try { oledbConn.Open(); using (DataTable Sheets = oledbConn.GetOleDbSchemaTable(OleDbSchemaGuid.Tables, null)) { for (int i = 0; i < Sheets.Rows.Count; i++) { string worksheets = Sheets.Rows[i]["TABLE_NAME"].ToString(); OleDbCommand cmd = new OleDbCommand(String.Format("SELECT * FROM [{0}]", worksheets), oledbConn); OleDbDataAdapter oleda = new OleDbDataAdapter(); oleda.SelectCommand = cmd; DataTable t = new DataTable(worksheets); oleda.Fill(t); ds.Tables.Add(t); } } } catch(Exception ex) { } finally { oledbConn.Close(); } return ds; } } }
Now we will create a view that contains file upload control and a button.When a request for ImportExcel of Home Controller is made,we will show file upload control with button control.When we select a file and press button it will make a post request to Home Controller and ImportExcel1 method will be called.Below is the Razor View for both request.
@using System.Data; @{ ViewBag.Title = "Import Excel With Multiple Sheets"; Layout = "~/Views/Shared/_Layout.cshtml"; } <h2>Import Excel With Multiple Sheets</h2> <!--[if !IE]><!--> <style type="text/css"> /* Generic Styling, for Desktops/Laptops */ table { width: 100%; border-collapse: collapse; } /* Zebra striping */ tr:nth-of-type(odd) { background: #eee; } th { background: #333; color: white; font-weight: bold; } td, th { padding: 6px; border: 1px solid #ccc; text-align: left; } /* Max width before this PARTICULAR table gets nasty This query will take effect for any screen smaller than 760px and also iPads specifically. */ @@media only screen and (max-width: 760px), (min-device-width: 768px) and (max-device-width: 1024px) { /* Force table to not be like tables anymore */ table, thead, tbody, th, td, tr { display: block; } /* Hide table headers (but not display: none;, for accessibility) */ thead tr { position: absolute; top: -9999px; left: -9999px; } tr { border: 1px solid #ccc; } td { /* Behave like a "row" */ border: none; border-bottom: 1px solid #eee; position: relative; padding-left: 50%; } td:before { /* Now like a table header */ position: absolute; /* Top/left values mimic padding */ top: 6px; left: 6px; width: 45%; padding-right: 10px; white-space: nowrap; } /* Label the data */ td:before { content: attr(data-title); } } </style> <!--<![endif]--> @using (Html.BeginForm("ImportExcel","Home",FormMethod.Post,new { enctype = "multipart/form-data" } )) { <table> <tr><td>Excel file</td><td><input type="file" id="FileUpload1" name="FileUpload1" /></td></tr> <tr><td></td><td><input type="submit" id="Submit" name="Submit" value="Submit" /></td></tr> </table> } <div> @if (ViewBag.Data != null) { foreach (DataTable dt in (ViewBag.Data as System.Data.DataSet).Tables) { <h3>@dt.TableName.Replace("$","")</h3> <hr/> <table id=""> <thead> <tr> @foreach (DataColumn column in dt.Columns) { <th>@column.ColumnName.ToUpper()</th> } </tr> </thead> @if (dt.Rows.Count > 0) { foreach (DataRow dr in dt.Rows) { <tr> @foreach (DataColumn column in dt.Columns) { <td data-title='@column.ColumnName'> @dr[column].ToString()&nbsp; </td> } </tr> } } else { int count = dt.Columns.Count; <tr> <td colspan='@count' style="color:red;"> No Data Found. </td> </tr> } </table> } } else { if (ViewBag.Error != null) { <table> <tr> <td style="color:red;"> @(ViewBag.Error != null ? ViewBag.Error.ToString() : "") </td> </tr> </table> } } </div>
Now if we run the above code and call the ImportExcel Method of Home Controller,
it works fine until we upload excel having sheets without filter.But as soon as we upload
an excel sheet with filter we will get the error:-
"The Microsoft Jet database engine could not find the object 'Sheet1$_'.
Make sure the object exists and that you spell its name and the path name correctly."
So why we are getting this sheet with "_"? As you can see in the above code "ConvertXSLXtoDataSet" method,we are using a method "GetOleDbSchemaTable".This "GetOleDbSchemaTable" also returns hidden tables in the excel file.  There is a simple workaround for this.We need to just check whether the sheet name contains "_" and ignore it while reading file.Below is the modified ConvertXSLXtoDataSet Method.

public static DataSet ConvertXSLXtoDataSet(string strFilePath, string connString) { OleDbConnection oledbConn = new OleDbConnection(connString); DataTable dt = new DataTable(); DataSet ds = new DataSet(); try { oledbConn.Open(); using (DataTable Sheets = oledbConn.GetOleDbSchemaTable(OleDbSchemaGuid.Tables, null)) { for (int i = 0; i < Sheets.Rows.Count; i++) { string worksheets = Sheets.Rows[i]["TABLE_NAME"].ToString(); if (!worksheets.Contains("_")) { OleDbCommand cmd = new OleDbCommand(String.Format("SELECT * FROM [{0}]", worksheets), oledbConn); OleDbDataAdapter oleda = new OleDbDataAdapter(); oleda.SelectCommand = cmd; DataTable t = new DataTable(worksheets); oleda.Fill(t); ds.Tables.Add(t); } } } } catch(Exception ex) { } finally { oledbConn.Close(); } return ds; }

Monday, March 20, 2017

Import excel with multiple sheets in Asp.net MVC

In this article, we will see how to import data from an Excel spreadsheet(xlx,xlsx) which contains multiple sheets using ASP.NET MVC. We will connect to a Microsoft Excel workbook using the OLEDB.NET data provider, extract data and then display the data in a View.
First of all we will create a ImportExcel in Home Controller which returns a View.This method will return a View for Get Request. Now we will create another method ImportExcel1 and decorate it with [HttpPost] Attribute.Since in MVC 2 Methods cannot have same method name,we can call 2 actions using Action Name attribute .So we will decorate ImportExcel1 with [ActionName("Importexcel")]. Now if we make a get request then ImportExcel will be called and for post request ImportExcel1 will be called.Below is the code to read excel files.
using System; using System.Collections.Generic; using System.Data; using System.Data.OleDb; using System.IO; using System.Linq; using System.Web; using System.Web.Mvc; using ExcelUpload.Models; namespace ExcelUpload.Controllers { public class HomeController : Controller { public ActionResult ImportExcel() { return View(); } [ActionName("Importexcel")] [HttpPost] public ActionResult Importexcel1() { if (Request.Files["FileUpload1"].ContentLength > 0) { string extension = System.IO.Path.GetExtension(Request.Files["FileUpload1"].FileName).ToLower(); string query = null; string connString = ""; string[] validFileTypes = { ".xls", ".xlsx" }; string path1 = string.Format("{0}/{1}", Server.MapPath("~/Content/Uploads"), Request.Files["FileUpload1"].FileName); if (!Directory.Exists(path1)) { Directory.CreateDirectory(Server.MapPath("~/Content/Uploads")); } if (validFileTypes.Contains(extension)) { if (System.IO.File.Exists(path1)) { System.IO.File.Delete(path1); } Request.Files["FileUpload1"].SaveAs(path1); //Connection String to Excel Workbook if (extension.Trim() == ".xls") { connString = "Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" + path1 + ";Extended Properties=\"Excel 8.0;HDR=Yes;IMEX=2\""; DataSet dt = Utility.ConvertXSLXtoDataSet(path1,connString); ViewBag.Data = dt; } else if (extension.Trim() == ".xlsx") { connString = "Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + path1 + ";Extended Properties=\"Excel 12.0;HDR=Yes;IMEX=2\""; DataSet dt = Utility.ConvertXSLXtoDataSet(path1, connString); ViewBag.Data = dt; } } else { ViewBag.Error = "Please Upload Files in .xls, .xlsx or .csv format"; } } return View(); } } }
Here we have created a static class Utility ,which contains a method ConvertXSLXtoDataSet. Below is the code for Utility class.
using System; using System.Collections.Generic; using System.ComponentModel; using System.Data; using System.Data.SqlClient; using System.IO; using System.Linq; using System.Web; using System.Data.OleDb; namespace ExcelUpload.Models { public static class Utility { public static DataSet ConvertXSLXtoDataSet(string strFilePath, string connString) { OleDbConnection oledbConn = new OleDbConnection(connString); DataTable dt = new DataTable(); DataSet ds = new DataSet(); try { oledbConn.Open(); using (DataTable Sheets = oledbConn.GetOleDbSchemaTable(OleDbSchemaGuid.Tables, null)) { for (int i = 0; i < Sheets.Rows.Count; i++) { string worksheets = Sheets.Rows[i]["TABLE_NAME"].ToString(); OleDbCommand cmd = new OleDbCommand(String.Format("SELECT * FROM [{0}]", worksheets), oledbConn); OleDbDataAdapter oleda = new OleDbDataAdapter(); oleda.SelectCommand = cmd; DataTable t = new DataTable(worksheets); oleda.Fill(t); ds.Tables.Add(t); } } } catch(Exception ex) { } finally { oledbConn.Close(); } return ds; } } }
Now we will create a view that contains file upload control and a button.When a request for ImportExcel of Home Controller is made,we will show file upload control with button control.When we select a file and press button it will make a post request to Home Controller and ImportExcel1 method will be called.Below is the Razor View for both request.
@using System.Data; @{ ViewBag.Title = "Import Excel With Multiple Sheets"; Layout = "~/Views/Shared/_Layout.cshtml"; } <h2>Import Excel With Multiple Sheets</h2> <!--[if !IE]><!--> <style type="text/css"> /* Generic Styling, for Desktops/Laptops */ table { width: 100%; border-collapse: collapse; } /* Zebra striping */ tr:nth-of-type(odd) { background: #eee; } th { background: #333; color: white; font-weight: bold; } td, th { padding: 6px; border: 1px solid #ccc; text-align: left; } /* Max width before this PARTICULAR table gets nasty This query will take effect for any screen smaller than 760px and also iPads specifically. */ @@media only screen and (max-width: 760px), (min-device-width: 768px) and (max-device-width: 1024px) { /* Force table to not be like tables anymore */ table, thead, tbody, th, td, tr { display: block; } /* Hide table headers (but not display: none;, for accessibility) */ thead tr { position: absolute; top: -9999px; left: -9999px; } tr { border: 1px solid #ccc; } td { /* Behave like a "row" */ border: none; border-bottom: 1px solid #eee; position: relative; padding-left: 50%; } td:before { /* Now like a table header */ position: absolute; /* Top/left values mimic padding */ top: 6px; left: 6px; width: 45%; padding-right: 10px; white-space: nowrap; } /* Label the data */ td:before { content: attr(data-title); } } </style> <!--<![endif]--> @using (Html.BeginForm("ImportExcel","Home",FormMethod.Post,new { enctype = "multipart/form-data" } )) { <table> <tr><td>Excel file</td><td><input type="file" id="FileUpload1" name="FileUpload1" /></td></tr> <tr><td></td><td><input type="submit" id="Submit" name="Submit" value="Submit" /></td></tr> </table> } <div> @if (ViewBag.Data != null) { foreach (DataTable dt in (ViewBag.Data as System.Data.DataSet).Tables) { <h3>@dt.TableName.Replace("$","")</h3> <hr/> <table id=""> <thead> <tr> @foreach (DataColumn column in dt.Columns) { <th>@column.ColumnName.ToUpper()</th> } </tr> </thead> @if (dt.Rows.Count > 0) { foreach (DataRow dr in dt.Rows) { <tr> @foreach (DataColumn column in dt.Columns) { <td data-title='@column.ColumnName'> @dr[column].ToString()&nbsp; </td> } </tr> } } else { int count = dt.Columns.Count; <tr> <td colspan='@count' style="color:red;"> No Data Found. </td> </tr> } </table> } } else { if (ViewBag.Error != null) { <table> <tr> <td style="color:red;"> @(ViewBag.Error != null ? ViewBag.Error.ToString() : "") </td> </tr> </table> } } </div>